-- Logs begin at Mon 2022-07-25 20:48:26 UTC, end at Mon 2022-07-25 22:09:30 UTC. -- Jul 25 21:42:11.842495 dv-osbrick-849019-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 21:42:11.849886 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 21:42:11 2022] *** Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: nodename: dv-osbrick-849019-3-ceph Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: machine: x86_64 Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: clock source: unix Jul 25 21:42:11.851898 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: pcre jit disabled Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: detected number of CPU cores: 4 Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: current working directory: / Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: detected binary path: /usr/bin/uwsgi-core Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: your processes number limit is 47680 Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: your memory page size is 4096 bytes Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: detected max file descriptor number: 2048 Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: lock engine: pthread robust mutexes Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: thunder lock: enabled Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 21:42:11.852376 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 21:42:11.897426 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: Python main interpreter initialized at 0x562e2c16a9c0 Jul 25 21:42:11.897426 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: python threads support enabled Jul 25 21:42:11.897426 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: your server socket listen backlog is limited to 100 connections Jul 25 21:42:11.897426 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: your mercy for graceful operations on workers is 90 seconds Jul 25 21:42:11.897811 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 21:42:11.897883 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: *** Operational MODE: preforking *** Jul 25 21:42:11.898141 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: *** uWSGI is running in multiple interpreter mode *** Jul 25 21:42:11.898141 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: spawned uWSGI master process (pid: 87146) Jul 25 21:42:11.898340 dv-osbrick-849019-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 21:42:11.898911 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: spawned uWSGI worker 1 (pid: 87159, cores: 1) Jul 25 21:42:11.899262 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: spawned uWSGI worker 2 (pid: 87160, cores: 1) Jul 25 21:42:11.901516 dv-osbrick-849019-3-ceph devstack@keystone.service[87146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 21:42:17.571668 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:42:17.571668 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: from cryptography.utils import int_from_bytes Jul 25 21:42:17.572466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:42:17.572466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: from cryptography.utils import int_from_bytes Jul 25 21:42:17.572891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:42:17.572891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: from cryptography.utils import int_from_bytes Jul 25 21:42:17.573002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:42:17.573002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: from cryptography.utils import int_from_bytes Jul 25 21:42:17.621630 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 21:42:17.621766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 21:42:17.621838 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 21:42:17.621961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 21:42:17.622088 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] command line args: [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 21:42:17.622157 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] command line args: [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 21:42:17.622253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 21:42:17.622402 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 21:42:17.622507 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ================================================================================ {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 21:42:17.622592 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ================================================================================ {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 21:42:17.622667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] admin_token = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.622816 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] admin_token = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.622902 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] config_dir = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] config_dir = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623262 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] config_source = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623331 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623430 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] debug = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] config_source = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] debug = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623876 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.623969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624037 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624391 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.624941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_config_append = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_config_append = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625378 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_dir = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_dir = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_file = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625630 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_file = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.625868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626120 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626678 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.626997 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627110 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627352 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.627913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628403 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628534 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628768 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.628906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629012 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629119 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629566 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] publish_errors = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] publish_errors = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.629963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630321 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630434 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.630960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631238 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] standard_threads = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631343 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] standard_threads = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631421 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] use_journal = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.631937 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632019 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] use_json = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] use_journal = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632175 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] use_stderr = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] use_json = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] use_syslog = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] use_stderr = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] use_syslog = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632517 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:42:17.632706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.632810 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.632913 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633120 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633740 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.633857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634133 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634474 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634590 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634824 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.634958 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.635072 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.635185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.635295 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.635418 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.635538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.636302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.636659 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.636829 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.637021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.637277 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.637438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.637592 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.637750 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.637750 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638534 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638673 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.638908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639196 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639196 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639745 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.639974 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640437 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640548 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.640898 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641022 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641136 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641373 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641719 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.641986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642799 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.642933 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643054 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643368 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643714 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643826 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.643946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644059 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644288 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644400 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644512 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644633 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644858 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.644970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645193 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645429 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645660 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.645884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646230 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646342 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.646972 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647210 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647450 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.647913 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648152 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648389 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.648988 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649467 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.649931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650157 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650276 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650756 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.650868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651449 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.651929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652652 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652781 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.652895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653121 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653346 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653470 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.653940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654054 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654297 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654635 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654747 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.654957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.655903 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656029 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.656864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657235 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657475 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657590 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657821 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.657936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658172 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658401 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658740 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.658861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659005 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659119 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659232 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.external = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659346 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659584 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.external = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659701 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659816 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.659955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660080 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.password = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] auth.token = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.password = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660676 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660789 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] auth.token = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.660903 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.661958 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662074 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662305 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662426 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662780 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.662894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663386 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663618 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663732 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663846 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.663960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664202 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.664919 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665276 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665400 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.665970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666420 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.666760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667147 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667277 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667393 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667747 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667861 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.667983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668099 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668454 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668567 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.668990 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669114 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669351 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669466 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669820 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.669934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670197 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670435 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670777 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.670898 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671031 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671426 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.671894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672016 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672245 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672473 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672596 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.672826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673041 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673155 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673155 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673593 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673707 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.673944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674173 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674648 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.674876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675018 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675139 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675381 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675848 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.675969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676087 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676201 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676779 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.676893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677819 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.677933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678055 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678173 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678515 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.678994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679464 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.679923 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680503 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680617 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.680969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681083 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681204 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681568 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681688 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681803 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.681917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.682032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.682146 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.682268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.682384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683400 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683872 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.683986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684100 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684456 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684684 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684798 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.684920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685378 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.685960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686073 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.686884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687257 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687725 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687841 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.687956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688190 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688666 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688781 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.688895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689165 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689280 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689864 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.689979 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690207 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690444 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690674 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690796 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.690912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691058 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691645 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.691946 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] role.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692875 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] role.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.692989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] role.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] role.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.693933 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694176 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694291 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694405 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694519 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694632 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.694871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695003 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695003 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.695986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696100 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696223 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696223 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.696892 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697472 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697588 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.697932 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.698046 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.698760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.698878 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699012 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699129 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699254 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699611 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699726 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699841 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.699955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700070 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700194 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700655 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700770 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.700892 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701359 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701712 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.701941 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702637 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.702870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703094 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703440 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.703907 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704021 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704491 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704835 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.704949 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705063 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705301 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705417 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705645 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.connection = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.705983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.connection = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706707 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.706955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707083 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707555 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707793 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.707909 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708138 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708489 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.708952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709067 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709660 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.709784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.710000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.710115 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 21:42:17.710231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.710231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.710231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:42:17.710231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 21:42:17.735637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.735798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.735884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.736018 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.736177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.736256 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.744237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.744472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.774572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.774801 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.775540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.775771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.828900 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.829086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.880559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.880789 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.881312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.881547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.945852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946515 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946732 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946816 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.946964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.947049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.947176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.969763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.969914 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.969994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970216 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970443 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970578 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970662 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.970884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.971081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.971176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.971296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.982332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.982883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.996415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.996540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.996625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.996702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.996807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.996905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87159) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:17.997732 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87160) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:42:18.014628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.014835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:42:18.015195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.015279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.015395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:42:18.015478 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:42:18.015659 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.015813 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.015897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.016015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:42:18.016150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.016284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.016397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.016544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.016800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.017053 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.026045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.026341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.026604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.026775 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.026883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.027070 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.027339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.027619 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.035845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.036608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.038758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.039067 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.039345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.039565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.039650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.039844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.039925 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040383 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040463 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040647 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040908 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.040998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.041171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.041250 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.041425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.041513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.041694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.042497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.042762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.064846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.065736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.066375 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.066650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.067337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.067612 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.071255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.071528 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.071801 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.072262 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.072539 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.072927 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.079231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.079505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.079982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.080258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.083590 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.083870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.084159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.084382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.084467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.084665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.084748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.084961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.085067 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.085333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.085414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.085602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.085684 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.085875 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.086155 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.086434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.103011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.103298 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.106439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.106718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.107315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.110455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.110683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.110880 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.114101 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.114396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.115210 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.118374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.118857 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.121574 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.121871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.122045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.122158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.122545 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.122826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.123141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.125205 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.125496 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.125770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.126044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.126311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.126686 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.139608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.139887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.140149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.140406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.143027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.143309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.143571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.143830 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.147333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.149028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.149310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.150691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.152611 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.152884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.153130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.153214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.153429 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.153512 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.153705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.156233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.156510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.156784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.157332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.157610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.165587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.165863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.166140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.166419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.166696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.167017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.167290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.169091 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.169366 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.169640 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.169916 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.170190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.170458 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.170728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.182955 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.186050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.186594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.189601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.190104 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.191751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.193265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.193540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.193624 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.193817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.195117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.196608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.196883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.197158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.303857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.305307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.307015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.308758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.309043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.309129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.309322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.309594 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.311938 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.312223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.312501 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.312770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.317595 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.317882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.318157 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.321087 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.321371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.321644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.325758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87160) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.326032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.326319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.326592 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.326862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.327163 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.327438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.327722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.328000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.328269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.328537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.328802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.329067 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.329148 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87159) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:42:18.329326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87160) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.329459 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.329736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.330007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.330276 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.330552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.330825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.331121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.331399 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.331665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.331937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.332193 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.332449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.332704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87159) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:42:18.362624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562e2c16a9c0 pid: 87160 (default app) Jul 25 21:42:18.365692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562e2c16a9c0 pid: 87159 (default app) Jul 25 21:42:18.366345 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d36a-3605-4700-a797-0c362731dbed None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:18.366632 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d36a-3605-4700-a797-0c362731dbed None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:18.366907 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d36a-3605-4700-a797-0c362731dbed None None] PATH_INFO: `/v3` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:18.371580 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Jul 25 21:42:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:26.424381 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:26.424959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:26.424959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:26.429150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:26.434263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:26.434678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:26.434851 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:26.513324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: INFO dbcounter [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] Registered counter for database keystone Jul 25 21:42:26.539248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG oslo_db.sqlalchemy.engines [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 21:42:26.546125 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writer thread running {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 21:42:26.721560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG passlib.handlers.bcrypt [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87160) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 21:42:26.721983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG passlib.handlers.bcrypt [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87160) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 21:42:26.777349 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:26.779032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:26.905449 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 21:42:27.038169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:27.112583 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: INFO dbcounter [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] Registered counter for database keystone Jul 25 21:42:27.131439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 21:42:27.137997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writer thread running {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 21:42:27.256467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4c12d-4c74-4970-8fa8-6fe3bdd4008d None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:27.261244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:27.261872 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:27.262151 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:27.262422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:27.270871 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:27.322391 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING keystone.common.rbac_enforcer.enforcer [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 21:42:27.322678 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b32c6-9ac9-4acc-b71c-d22f6584b346 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:27.332467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Jul 25 21:42:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:42:27.338663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:27.353044 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca877e-b5c0-407c-9ffa-92e9e65a2df9 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:27.357499 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:27.358591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:27.358876 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:27.359188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] PATH_INFO: `/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:27.360706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] RBAC: Authorizing `identity:get_project(project_id=2eb79fbfdb0c462f815d677c4fd9d2a2)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:27.411700 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 21:42:27.412047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5859c-2b9f-4dce-977a-22a1617b0683 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:27.416620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Jul 25 21:42:27 2022] GET /identity/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:29.607421 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4482f-35d0-4d2c-a86d-34a6989c88ef None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:29.607962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4482f-35d0-4d2c-a86d-34a6989c88ef None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:29.607962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4482f-35d0-4d2c-a86d-34a6989c88ef None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:29.612032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:42:29.617381 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11954a9-6983-4235-b709-af2bba762895 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:29.617786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11954a9-6983-4235-b709-af2bba762895 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:29.617921 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11954a9-6983-4235-b709-af2bba762895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:29.638687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-a11954a9-6983-4235-b709-af2bba762895 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:29.640231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-a11954a9-6983-4235-b709-af2bba762895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:29.648030 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 21:42:29.671152 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4482f-35d0-4d2c-a86d-34a6989c88ef None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:29.683686 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4482f-35d0-4d2c-a86d-34a6989c88ef None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:29.687950 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c86af-4a4f-4b20-b11e-de7423a6e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:29.688561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c86af-4a4f-4b20-b11e-de7423a6e3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:29.688845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c86af-4a4f-4b20-b11e-de7423a6e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:29.689120 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c86af-4a4f-4b20-b11e-de7423a6e3f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:29.696808 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c86af-4a4f-4b20-b11e-de7423a6e3f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:29.699344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c86af-4a4f-4b20-b11e-de7423a6e3f9 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:29.708007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Jul 25 21:42:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:42:29.713302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11954a9-6983-4235-b709-af2bba762895 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:29.722123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11954a9-6983-4235-b709-af2bba762895 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:29.726779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a80d-807e-4b4b-9412-93796c6e97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:29.727389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a80d-807e-4b4b-9412-93796c6e97a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:29.727679 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a80d-807e-4b4b-9412-93796c6e97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:29.727954 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a80d-807e-4b4b-9412-93796c6e97a4 admin admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:29.729360 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a80d-807e-4b4b-9412-93796c6e97a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:29.731254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a80d-807e-4b4b-9412-93796c6e97a4 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:29.732792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Jul 25 21:42:29 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:31.991292 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b604d95-ae92-4ffb-87cc-4964bf5554c3 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:31.991848 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b604d95-ae92-4ffb-87cc-4964bf5554c3 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:31.991848 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b604d95-ae92-4ffb-87cc-4964bf5554c3 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:31.993149 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:31.998706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:31.999113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:31.999409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.019345 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:32.020541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:32.023907 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e68e-d325-427e-a2bc-90757cae53fe None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.024194 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e68e-d325-427e-a2bc-90757cae53fe None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.024470 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e68e-d325-427e-a2bc-90757cae53fe None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.025782 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:42:32.030879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.031186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.031459 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.073519 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG passlib.handlers.bcrypt [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87159) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 21:42:32.073931 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG passlib.handlers.bcrypt [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87159) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 21:42:32.100011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:32.119143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:32.121246 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:32.124035 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.146991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.221028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:32.226166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c5e3c-e5ba-4f18-b65d-ff2a8464f396 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.244435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.259380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.260023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.260328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.260603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.271471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:32.280260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:32.281189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:32.282020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:42:32.287468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.342834 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184cec6-7c31-4e84-b6d6-9a86272a2f7b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.345070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.368730 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.380841 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.381704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.381983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.382256 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.387016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86769c0-108d-4366-9edd-53a3e8fb49a8 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.419901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.420516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.420794 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.421071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.421784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:32.422086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.423520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.434840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:32.440297 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.447314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.449348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.544809 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1dd67-4d1b-4ca6-85ac-4f25bf367259 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.548346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:42:32.553923 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.556588 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.578171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.578821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.579131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.579413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.580585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.582032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.583643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:32.589361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.603455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.651290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f962-860a-4ccb-a60b-3751f565af97 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.684394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.685238 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.685512 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.685781 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.689587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c5dde-198b-48e5-bb9c-11da39ea934b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.705680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.707176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.724040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:42:32.724589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:32.725535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:32.726412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:42:32.726412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:42:32.726412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:42:32.726412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:32.726642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.726642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.726642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.726814 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:42:32.726885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.727938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.729667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:32.732297 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.735142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:32.789636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.814393 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:32.832616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01279855-c0b8-42cf-8b99-f6f8e50168b8 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.834006 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9f73-4ca3-41de-91aa-67c2ee3499c0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:32.867019 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.867645 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.867922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.868201 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.868893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:32.869193 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.870692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be07dee-af32-43c4-abf2-ffaae84e4812 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.871493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:32.872105 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:32.872380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:32.872646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:32.873423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.domain.id=default, user.id=a5621789b9f4468f90a50f03b6178b3f) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:32.873724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:32.875181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069234cb-2f90-4cb4-8d7f-24a854801613 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:32.881840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/role_assignments?user.id=a5621789b9f4468f90a50f03b6178b3f&scope.domain.id=default&role.id=068868605675478a8abe0ef53a447f78 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:32.888548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:36.275502 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cade0d-4f23-4474-9fe3-6e216dbfde6b None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.277108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cade0d-4f23-4474-9fe3-6e216dbfde6b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.277590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cade0d-4f23-4474-9fe3-6e216dbfde6b None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.279150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:36.285110 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64d0b-16f9-4e9a-b07d-d3a5ab534d33 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.285982 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64d0b-16f9-4e9a-b07d-d3a5ab534d33 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.286459 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d64d0b-16f9-4e9a-b07d-d3a5ab534d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.311988 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-29d64d0b-16f9-4e9a-b07d-d3a5ab534d33 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:36.313528 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-29d64d0b-16f9-4e9a-b07d-d3a5ab534d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:36.405527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:36.444542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cade0d-4f23-4474-9fe3-6e216dbfde6b None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:36.511528 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3a47-c732-4cb7-9364-9813b79ed306 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.511816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3a47-c732-4cb7-9364-9813b79ed306 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.512350 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e3a47-c732-4cb7-9364-9813b79ed306 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.513879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:36.518963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef62ea-5c42-4a40-97af-d4a11c6d3826 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.519466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef62ea-5c42-4a40-97af-d4a11c6d3826 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.519944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef62ea-5c42-4a40-97af-d4a11c6d3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.543767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-7bef62ea-5c42-4a40-97af-d4a11c6d3826 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:36.545509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-7bef62ea-5c42-4a40-97af-d4a11c6d3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:36.594387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:36.594566 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cade0d-4f23-4474-9fe3-6e216dbfde6b None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:36.622625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:36.624449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c568-325a-4dc4-afb0-f047aaf832e9 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.625056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c568-325a-4dc4-afb0-f047aaf832e9 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.625527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c568-325a-4dc4-afb0-f047aaf832e9 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.627044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:36.628441 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ae4e-5c56-4c44-9e61-6202c51dca56 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.628917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ae4e-5c56-4c44-9e61-6202c51dca56 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.629551 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119ae4e-5c56-4c44-9e61-6202c51dca56 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.630609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643669-bc5e-415b-bfbe-2a33beca0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:36.631312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 15/27] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:36.631416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643669-bc5e-415b-bfbe-2a33beca0557 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.631614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643669-bc5e-415b-bfbe-2a33beca0557 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.631868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643669-bc5e-415b-bfbe-2a33beca0557 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.633084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.633660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.634261 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.643337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80643669-bc5e-415b-bfbe-2a33beca0557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-80643669-bc5e-415b-bfbe-2a33beca0557 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:36.648795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:36.649664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:36.650870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:36.651781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.651781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.651781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.657157 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:36.658972 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:36.659445 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:36.672142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:36.673344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:36.735735 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 16/29] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:36.737159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:36.744322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 14/30] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:36.745218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:36.846521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb031d74-e35a-49b0-9f0f-9a8ffab3340a None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:36.849590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73103d99-7ecd-4b20-aa5c-af84a1ea890e None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:36.856704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:36.887378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:36.888264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.888675 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:36.888832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.889025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.889683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:36.889927 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:36.890131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:36.890498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:36.891002 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:36.891763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:36.892040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:36.893627 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:36.897635 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:36.906341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:36.907331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.018849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09935975-d605-4ab0-a16b-0dca9849660b None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.038162 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 15/32] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 21:42:36 2022] POST /identity/v3/roles => generated 225 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:37.039528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.058563 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.059586 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.060009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.060421 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.061347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.063067 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.164032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89a6b6-6b34-4851-ac7e-92a8c761cb8c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.201618 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.202530 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.203031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.203464 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.209178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 18/33] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 21:42:36 2022] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:37.210716 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.216751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.218880 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-9b4429ed-9d7e-4588-9396-232c72880704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:42:37.236344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:37.237271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:37.238123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:42:37.238123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:42:37.238123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:42:37.238123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:37.240062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 16/34] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:37.241749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4615-4f5f-4d03-b493-f4f1b45956f0 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.242226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4615-4f5f-4d03-b493-f4f1b45956f0 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.242678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4615-4f5f-4d03-b493-f4f1b45956f0 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.244275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 17/35] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:37.246329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4615-4f5f-4d03-b493-f4f1b45956f0 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.254994 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:37.339605 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:37.340139 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbd76-ebce-411a-a130-7d1e385719e5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.388715 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b984dea-8d3a-48ac-b020-e71b84e58a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.389534 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b984dea-8d3a-48ac-b020-e71b84e58a94 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.389887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b984dea-8d3a-48ac-b020-e71b84e58a94 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.390239 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b984dea-8d3a-48ac-b020-e71b84e58a94 None admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.392275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b984dea-8d3a-48ac-b020-e71b84e58a94 None admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.394188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b984dea-8d3a-48ac-b020-e71b84e58a94 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.396336 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 19/36] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:37 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:37.399451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.400038 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.400525 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.411630 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4615-4f5f-4d03-b493-f4f1b45956f0 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.422132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:37.424172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:37.462715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.464345 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.464847 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.465320 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.466382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:37.466771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.468360 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.489275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 18/37] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:37.490567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.523666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 20/38] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:37.524786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.552472 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:37.602232 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c12d7-c557-49f8-94ed-d944e7f31f21 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.608963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:37.625307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a7bd5-33b3-4e13-b286-3e470312feae None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.636086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78dc45-c28e-4513-8087-c19ec181d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.636736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78dc45-c28e-4513-8087-c19ec181d75f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.637015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78dc45-c28e-4513-8087-c19ec181d75f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.637284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78dc45-c28e-4513-8087-c19ec181d75f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.638437 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78dc45-c28e-4513-8087-c19ec181d75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.639934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78dc45-c28e-4513-8087-c19ec181d75f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.641522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 19/39] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:37.642640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80621bc-6411-44ac-84e9-be005939e195 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.642939 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80621bc-6411-44ac-84e9-be005939e195 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.643224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80621bc-6411-44ac-84e9-be005939e195 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.644461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 20/40] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:37.645150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80621bc-6411-44ac-84e9-be005939e195 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.664469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.665104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.665387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.665664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.666341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.668359 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.706966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:42:37 2022] POST /identity/v3/projects => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:37.706966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:37.777258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80621bc-6411-44ac-84e9-be005939e195 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.783837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:37.814506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63780e-ebc3-4378-bbc5-d09353da2de4 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:37.819246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f061fc0-fc11-4dc5-a160-d4076f6aa660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.819888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f061fc0-fc11-4dc5-a160-d4076f6aa660 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.820167 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f061fc0-fc11-4dc5-a160-d4076f6aa660 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.820440 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f061fc0-fc11-4dc5-a160-d4076f6aa660 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.821166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f061fc0-fc11-4dc5-a160-d4076f6aa660 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.823211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f061fc0-fc11-4dc5-a160-d4076f6aa660 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.841901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 21:42:37 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:37.843753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.844109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.844462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.866093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:37.867438 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:37.868066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:37.868720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:37.869211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:37.870337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] PATH_INFO: `/v3/domains/default/users/a5621789b9f4468f90a50f03b6178b3f/roles/068868605675478a8abe0ef53a447f78` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:37.872949 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a5621789b9f4468f90a50f03b6178b3f, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:37.874464 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:37.896286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Jul 25 21:42:37 2022] PUT /identity/v3/domains/default/users/a5621789b9f4468f90a50f03b6178b3f/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:42:37.907983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:37.967797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 22/44] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:37.996985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:38.113627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db3c0-21be-43e0-862d-46b6d6d339ea None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:38.148901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1441be-6469-44aa-8385-b8b834820a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:38.149557 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1441be-6469-44aa-8385-b8b834820a50 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:38.149839 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1441be-6469-44aa-8385-b8b834820a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:38.150117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1441be-6469-44aa-8385-b8b834820a50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:38.151844 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1441be-6469-44aa-8385-b8b834820a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:38.153334 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1441be-6469-44aa-8385-b8b834820a50 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:38.155162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:38.160908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:38.256067 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d903fb0-484b-420d-9fb9-b8ec80184eec None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:38.289706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18859a73-3096-458e-87a4-c89785eaf918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:38.290332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859a73-3096-458e-87a4-c89785eaf918 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:38.290613 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859a73-3096-458e-87a4-c89785eaf918 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:38.290885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859a73-3096-458e-87a4-c89785eaf918 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:38.292116 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859a73-3096-458e-87a4-c89785eaf918 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:38.293579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859a73-3096-458e-87a4-c89785eaf918 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:38.320696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:42:38 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:40.149559 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33acba3-5f07-4570-9b60-913b13e22706 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.150112 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33acba3-5f07-4570-9b60-913b13e22706 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.150198 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33acba3-5f07-4570-9b60-913b13e22706 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.152212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:40.157703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.158087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.158269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.176965 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:40.178157 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:40.189008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:40.244953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:40.268644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33acba3-5f07-4570-9b60-913b13e22706 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.278435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:40.370525 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33acba3-5f07-4570-9b60-913b13e22706 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:40.407694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd62c29-eb16-47b2-be8e-87d2e33515d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:40.408263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62c29-eb16-47b2-be8e-87d2e33515d9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.408540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62c29-eb16-47b2-be8e-87d2e33515d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.408807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62c29-eb16-47b2-be8e-87d2e33515d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.429108 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62c29-eb16-47b2-be8e-87d2e33515d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-0cd62c29-eb16-47b2-be8e-87d2e33515d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:40.436233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:40.437130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:40.437897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:40.444958 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.537132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2da5-a230-4680-b7e7-6e5579cd203c None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.537416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2da5-a230-4680-b7e7-6e5579cd203c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.537695 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2da5-a230-4680-b7e7-6e5579cd203c None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.539057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 26/50] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:42:40.544343 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.544626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.544735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d84f-9d5e-477f-b889-fb56ea0fa080 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:40.544901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.563228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:40.564405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:40.579619 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:40.580240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.580517 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.580798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.581504 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:40.581806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:40.583218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:40.591233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 25/51] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:40.596847 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.609217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:40.627177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:40.634865 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 27/52] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:40.659012 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.700404 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909f991-54d3-4071-bb4d-8ea1ea84ef18 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:40.734111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:40.734760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.735268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.735760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.737776 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:40.740419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:40.743464 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:40 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:40.749510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.776062 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddbb77-dbed-4c0b-be71-06713be68751 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:40.809711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:40.810354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.810628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.810897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.812156 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:40.813494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:40.815071 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:40.820488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.828104 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:40.852016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598d0eb-704c-4d77-8f09-bacf7d159e29 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:40.883326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:40.885860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:40.886556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.886839 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.887146 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.888298 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:40.889743 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:40.891363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:40.896994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:40.921070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69b02-4947-4033-ac4f-60856dddd8dc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:40.953513 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee0b19-c17e-40ff-b510-bc6abdd26361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:40.954128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee0b19-c17e-40ff-b510-bc6abdd26361 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:40.954406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee0b19-c17e-40ff-b510-bc6abdd26361 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:40.954683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee0b19-c17e-40ff-b510-bc6abdd26361 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:40.955378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee0b19-c17e-40ff-b510-bc6abdd26361 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:40.956804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee0b19-c17e-40ff-b510-bc6abdd26361 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:40.983841 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 29/56] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Jul 25 21:42:40 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:42:40.998589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00475-c591-4e37-8c33-e15df48c13b9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:41.035078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20443d-091c-4793-a580-a70545217645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:41.035719 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20443d-091c-4793-a580-a70545217645 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:41.036002 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20443d-091c-4793-a580-a70545217645 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:41.036279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20443d-091c-4793-a580-a70545217645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:41.037092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20443d-091c-4793-a580-a70545217645 None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.domain.id=default, user.id=a5621789b9f4468f90a50f03b6178b3f) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:41.037408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20443d-091c-4793-a580-a70545217645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:41.038905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20443d-091c-4793-a580-a70545217645 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:41.045706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Jul 25 21:42:40 2022] GET /identity/v3/role_assignments?user.id=a5621789b9f4468f90a50f03b6178b3f&scope.domain.id=default&role.id=068868605675478a8abe0ef53a447f78 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:43.241056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344ab0-c153-424a-995b-9aaac305f6ca None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:43.241587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344ab0-c153-424a-995b-9aaac305f6ca None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:43.241673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344ab0-c153-424a-995b-9aaac305f6ca None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:43.242995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:43.248724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:43.249110 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:43.249285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:43.268066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:43.269272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:43.271314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:43.336837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:43.364446 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344ab0-c153-424a-995b-9aaac305f6ca None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:43.467779 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344ab0-c153-424a-995b-9aaac305f6ca None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:43.483635 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:43.502137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6ab38-7166-4e67-982e-64c55a1464c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:43.502716 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6ab38-7166-4e67-982e-64c55a1464c9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:43.503035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6ab38-7166-4e67-982e-64c55a1464c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:43.503313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6ab38-7166-4e67-982e-64c55a1464c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:43.504481 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6ab38-7166-4e67-982e-64c55a1464c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:43.505920 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6ab38-7166-4e67-982e-64c55a1464c9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:43.507523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:43.513251 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:43.608993 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb819-c263-4c7d-a81d-30f12a23b253 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:43.641559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91803121-83e8-43ec-93fd-7c1c619d9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:43.642177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91803121-83e8-43ec-93fd-7c1c619d9e12 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:43.642458 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91803121-83e8-43ec-93fd-7c1c619d9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:43.642737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91803121-83e8-43ec-93fd-7c1c619d9e12 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:43.643441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91803121-83e8-43ec-93fd-7c1c619d9e12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:43.644907 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91803121-83e8-43ec-93fd-7c1c619d9e12 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:43.658875 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:43.671553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:42:43 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:46.983882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7579-fd24-4a4b-88be-a9b4f48e0c43 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:46.984926 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7579-fd24-4a4b-88be-a9b4f48e0c43 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:46.985407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d7579-fd24-4a4b-88be-a9b4f48e0c43 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:46.986997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:46.992506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c1790-e677-4625-91f6-e795aaf54cc5 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:46.993333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c1790-e677-4625-91f6-e795aaf54cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:46.993824 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c1790-e677-4625-91f6-e795aaf54cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.023948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-1b9c1790-e677-4625-91f6-e795aaf54cc5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:47.025454 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-1b9c1790-e677-4625-91f6-e795aaf54cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:47.114297 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:47.135804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed56ad-efbc-431f-bb62-2af6cc33214d None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.136401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed56ad-efbc-431f-bb62-2af6cc33214d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.136893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed56ad-efbc-431f-bb62-2af6cc33214d None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.138422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 33/64] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:47.144289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.144900 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.145379 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.151828 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed56ad-efbc-431f-bb62-2af6cc33214d None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.169093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:47.170694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:47.279469 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 32/65] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:47.308615 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed56ad-efbc-431f-bb62-2af6cc33214d None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:47.354453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:47.355146 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.355434 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.355715 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.365904 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.388008 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:47.393637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:47.394522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:47.395332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 34/66] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:47.402676 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.463159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:47.489048 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:47.580703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6d4b-80ff-47fb-9905-b76f8ae4c1d6 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:47.584436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfbce-d6d6-494a-8c69-05ef3a80e34b None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:47.620083 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:47.620719 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.620997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.621278 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.621996 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:47.622090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f931ff-cd0d-4bde-89fc-ca8b0cbc64f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:47.622303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:47.622686 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f931ff-cd0d-4bde-89fc-ca8b0cbc64f8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.622999 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f931ff-cd0d-4bde-89fc-ca8b0cbc64f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.623277 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f931ff-cd0d-4bde-89fc-ca8b0cbc64f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.623836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa854b-936f-45f3-8d60-e4e6008fc43c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:47.632456 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 35/67] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:47.633638 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6371e-ea74-437d-95bd-d8f8d44de1fa None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.633928 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6371e-ea74-437d-95bd-d8f8d44de1fa None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.634205 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6371e-ea74-437d-95bd-d8f8d44de1fa None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.634648 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f931ff-cd0d-4bde-89fc-ca8b0cbc64f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:47.635475 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 36/68] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:47.639757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea147-9f0f-46f1-9b6e-59f22d898af7 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.639757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea147-9f0f-46f1-9b6e-59f22d898af7 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.639757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea147-9f0f-46f1-9b6e-59f22d898af7 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.639757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 37/69] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:47.639757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea147-9f0f-46f1-9b6e-59f22d898af7 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-06f931ff-cd0d-4bde-89fc-ca8b0cbc64f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:47.644215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:47.645062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:47.645856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 33/70] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:42:47.647255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024952-5ad5-4419-bfe9-55ad25a6c54a None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.647414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024952-5ad5-4419-bfe9-55ad25a6c54a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.647765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024952-5ad5-4419-bfe9-55ad25a6c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.666423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c4024952-5ad5-4419-bfe9-55ad25a6c54a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:47.668237 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c4024952-5ad5-4419-bfe9-55ad25a6c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:47.737058 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 34/71] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:47.747089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02464f6b-8930-47fe-97e6-04210af86104 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.747089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02464f6b-8930-47fe-97e6-04210af86104 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.747089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02464f6b-8930-47fe-97e6-04210af86104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.755604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-02464f6b-8930-47fe-97e6-04210af86104 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:47.756769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-02464f6b-8930-47fe-97e6-04210af86104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:47.760604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea147-9f0f-46f1-9b6e-59f22d898af7 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:47.768077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:47.795999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:47.796676 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.796960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.797230 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.797558 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:47.798394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:47.800124 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:47.801718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 38/72] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:47.802474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.825286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 35/73] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:47.826890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dbd6-284c-4dc8-8b51-24c0141208bf None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.827215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dbd6-284c-4dc8-8b51-24c0141208bf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.827494 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3dbd6-284c-4dc8-8b51-24c0141208bf None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.828742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 36/74] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:47.831123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3dbd6-284c-4dc8-8b51-24c0141208bf None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.902152 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a7ab-12c4-40ae-afe2-e7e86d0d1f44 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:47.931109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3dbd6-284c-4dc8-8b51-24c0141208bf None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:47.934951 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:47.935573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.936463 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.936619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.937289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:47.937596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:47.939014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:47.948239 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 39/75] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:47.949130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:47.967271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4302415-e1d7-44cf-a16f-776de3093843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:47.967908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4302415-e1d7-44cf-a16f-776de3093843 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.968183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4302415-e1d7-44cf-a16f-776de3093843 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.968457 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4302415-e1d7-44cf-a16f-776de3093843 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.969580 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4302415-e1d7-44cf-a16f-776de3093843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:47.971050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4302415-e1d7-44cf-a16f-776de3093843 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:47.972751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 37/76] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:47.973689 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:47.973968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:47.974234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:47.983782 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:47.991544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:47.992713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:48.027812 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.047786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c569f8b-4320-4e1c-bbea-345d32c6bebc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.058678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 38/77] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:48.059528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.098509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.099101 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.099388 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.099668 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.160353 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee2d4-434b-4cb2-a05c-0a3781e3e9ce None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.170719 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.172219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.193812 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.194450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.194728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.195029 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.205392 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.205569 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:48.210842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:48.211896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:48.212688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:48.213427 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.244326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.272039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:42:48.272868 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.312317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c670-ed1b-4c9c-b499-d9788e1dd924 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.345131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.345766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.346050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.346333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.359149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.360554 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.362356 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:48.363024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.372129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7189ed-0d4e-4f5b-806b-599b95edd5c9 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.405131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.405749 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.406029 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.406303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.407002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.408708 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.420236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.436510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 41/81] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:42:48 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:48.436510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.464403 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.482140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20cb89-d42a-4b0b-ad2e-f92b7f62733b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.529894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.530594 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.530948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.531475 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.545544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:48.550685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:48.551745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:48.552561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:48.553213 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.570117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763912-f5d8-4a6d-ac07-a249da3af6d0 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.618293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.618293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.618293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.618619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.620286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:48.620286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.621063 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.629637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:48.630856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.675587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a77b04-5060-437d-bc3b-b486bf461b18 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.710053 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.727845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.729383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.730663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.731111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.732557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.734244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.737065 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:48.738078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.762565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:48.771597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cef5a-fca1-4ed1-8ec7-a08db9c7e8d7 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.815541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.819494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.819494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.819494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.864612 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126513-7577-40dd-8d2e-a3e7c52f7bb2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:48.900942 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:48.901488 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:48.901889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:48.902170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:48.902948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:48.903271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.904723 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.913178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:48.915015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:48.915139 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 43/85] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:48.915990 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:48.988821 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.012746 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.034479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87b29-f7a2-46f9-9884-7e62dfd35cd4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.053495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:42:49.054984 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:49.071795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.072316 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.073198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.073493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.074705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.076218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.077857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 44/87] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:48 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:49.083080 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:49.187670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d01da0-d1f2-40a8-b5dc-0211b46ceee2 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.205101 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c320-1c40-4b5b-8ae9-b0b850ae8faf None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.225902 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.226580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.226867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.227172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.227966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=a5621789b9f4468f90a50f03b6178b3f) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:49.228283 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.230326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.238402 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/role_assignments?user.id=a5621789b9f4468f90a50f03b6178b3f&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=068868605675478a8abe0ef53a447f78 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:49.239170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:49.250233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.251112 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.251268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.251547 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.252775 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.254233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.255903 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:49.256783 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:49.265410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.281382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.378491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f820-b752-4959-abe0-dd2ce3d49db2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.380739 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4f0f-1a83-49f5-9364-429396eef9f6 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.419693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.420327 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.420616 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.420891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.440651 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.441233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.441513 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.441790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.443824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.446425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.449540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 45/90] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:49.451487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:49.549120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.550613 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.581699 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.596041 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.629110 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9f41f-ec3c-44b8-b279-9ca08c05af8e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.698626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.699519 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.699809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.700090 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.736067 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 46/91] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:42:49.741262 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:49.845391 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.847249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.941759 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce647d7-5f45-4305-abdc-0ea0d3ba0051 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:49.961588 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:49.981866 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:49.982486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:49.982768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:49.983076 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:49.984155 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=03092f47767a46b399baeb618ef35c79) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:49.984468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:49.985926 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:49.992578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/role_assignments?user.id=03092f47767a46b399baeb618ef35c79&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:49.993768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:50.026847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:50.058443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 46/93] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:42:50.064523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:50.163943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663e24-61ee-46c1-b447-8bd2b7348a2a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:50.231242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:50.231822 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:50.232110 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:50.232390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:50.235931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:50.238696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:50.240643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:49 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:50.246477 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:50.313834 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec15bb-0498-4e13-9fe4-d37c9406338c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:50.343037 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:50.362622 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:50.363314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:50.363603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:50.363877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] PATH_INFO: `/v3/projects/caca8da6ea064104bfa4cebe5b56e524` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:50.365062 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=caca8da6ea064104bfa4cebe5b56e524)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:50.366950 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:50.368382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:50 2022] GET /identity/v3/projects/caca8da6ea064104bfa4cebe5b56e524 => generated 312 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:50.374231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:50.434734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:50.488183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baadd4-c83b-462f-99a4-f52109af9fe8 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:50.493081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f1196-64dd-4bc5-9967-70a97285e52e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:50.526572 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:50.527232 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:50.527514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:50.527782 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:50.528758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=caca8da6ea064104bfa4cebe5b56e524, user.id=03092f47767a46b399baeb618ef35c79) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:50.529079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:50.530610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddfe08-e630-4e3c-91b8-ec524dbd7967 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:50.543245 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:42:50 2022] GET /identity/v3/role_assignments?user.id=03092f47767a46b399baeb618ef35c79&scope.project.id=caca8da6ea064104bfa4cebe5b56e524&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:50.604943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:50.605598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:50.605882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:50.606158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:50.607012 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] RBAC: Adding query filter params (role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=03092f47767a46b399baeb618ef35c79) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:50.607329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:50.608894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e375a-941e-4c55-9a3e-5e24ac72cb5a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:50.617852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:42:50 2022] GET /identity/v3/role_assignments?user.id=03092f47767a46b399baeb618ef35c79&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 259 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:51.100912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e65f-d3f1-49a9-9c79-38142fccd45b None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.101947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e65f-d3f1-49a9-9c79-38142fccd45b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.102461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46e65f-d3f1-49a9-9c79-38142fccd45b None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:51.105034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:51.113435 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.114273 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.114986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:51.139883 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:51.141427 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:51.225629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:51.260352 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46e65f-d3f1-49a9-9c79-38142fccd45b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:51.394051 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46e65f-d3f1-49a9-9c79-38142fccd45b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:51.423313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:51.442396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:51.443079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.443366 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.443642 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:51.457537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:51.463753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:51.464613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:42:51.465415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:51.478955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 50/100] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:51.483217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:51.561198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:51.630852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805c27-4bdb-466a-9a14-4929406b22e0 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:51.677626 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:51.678178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.678464 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.678740 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:51.679496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:51.679806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:51.681187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd9e73-32bc-4ace-a3ce-fcaf5197d223 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:51.690232 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 51/101] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:51.696026 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:51.723534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445b7d-b6dd-48eb-8137-728547a093ec None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.724173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445b7d-b6dd-48eb-8137-728547a093ec None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.724663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445b7d-b6dd-48eb-8137-728547a093ec None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:51.726518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 52/102] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:42:51.732377 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.733009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.733497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:51.764374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:51.766507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:51.882625 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 53/103] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:51.906713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6b05-47a9-4475-a506-940cc4fc38fc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:51.914874 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:51.970245 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:51.985701 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:51.986809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:51.987272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:51.987731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] PATH_INFO: `/v3/users/579fb59bdd624ecaae8deb09a7b95ee9` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.055661 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] RBAC: Authorizing `identity:get_user(user_id=579fb59bdd624ecaae8deb09a7b95ee9)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:52.057736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:52.059514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 51/104] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:51 2022] GET /identity/v3/users/579fb59bdd624ecaae8deb09a7b95ee9 => generated 289 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:52.068034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:52.082008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54ad15-45e6-4823-b9eb-de17d48bf677 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:52.135723 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:52.136444 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.136788 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.137074 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.139060 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:52.140523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:52.144361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 54/105] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:52.148788 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:52.186812 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:52.285987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84141aa0-9c3f-4eaa-a4e8-7370e1a45f9f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:52.301361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408278f7-c6f3-4a4d-993c-9b2c8e2ae98b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:52.303930 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:52.334427 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:52.335081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.335362 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.335639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.375290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54092fea-7f23-48ad-8bfc-0004b9232589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:52.375934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54092fea-7f23-48ad-8bfc-0004b9232589 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.376217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54092fea-7f23-48ad-8bfc-0004b9232589 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.376492 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54092fea-7f23-48ad-8bfc-0004b9232589 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.377197 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54092fea-7f23-48ad-8bfc-0004b9232589 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:52.378670 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54092fea-7f23-48ad-8bfc-0004b9232589 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:52.439039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 55/106] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:42:52 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:52.440315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd5b0-e72c-406d-b7f1-d20b4fad483a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.440608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd5b0-e72c-406d-b7f1-d20b4fad483a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.440884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcd5b0-e72c-406d-b7f1-d20b4fad483a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.442087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 56/107] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:52.449362 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.449687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.449914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.477838 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:52.479913 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:52.503837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:52.507860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:52.552982 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:52.639112 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 57/108] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:52.676569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 52/109] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:42:52.679223 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:52.690297 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:52.866647 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:52.906606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06315266-3afb-4cd2-b159-3889cdb99ff6 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:52.912109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773519-eb1f-4f81-ac2e-746ad1b10b40 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:52.954395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:52.955357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.955778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.956196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:52.960147 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:52.962348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:52.967174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 53/110] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:52 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:52.970897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:52.979607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:52.985090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:52.985823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:52.986104 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:52.986374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.012143 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:53.017188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:53.018062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:53.018830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:53.022315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 58/111] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:53.028663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:53.150154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcc372-70f1-4d41-a704-b3c33cfe2f2d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:53.156758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7328-66aa-4619-afcf-1a7412c82029 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:53.197625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:53.198879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.203243 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.203547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.204369 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] RBAC: Adding query filter params (role.id=2e79002ba27647eb8ccda5f9f6ab43bc, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=579fb59bdd624ecaae8deb09a7b95ee9) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:53.204690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:53.206179 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:53.216293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 54/112] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:42:52 2022] GET /identity/v3/role_assignments?user.id=579fb59bdd624ecaae8deb09a7b95ee9&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=2e79002ba27647eb8ccda5f9f6ab43bc => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:53.245092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:53.245092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.245092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.245092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.245975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:53.245975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:53.245975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:53.261190 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 59/113] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:53.267054 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:53.363798 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:53.409534 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a490-ef36-4233-855c-dfa0dddd5438 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:53.458743 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:53.459455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.459738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.460015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.466091 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:53.466091 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:53.467304 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 55/114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:53 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:53.472640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:53.482345 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:53.610659 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd75b92-60cc-4ae9-ad77-7b222dcc6084 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:53.649859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921d1dd-58bb-499b-9b74-b8f89d2f49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:53.651055 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d1dd-58bb-499b-9b74-b8f89d2f49ff None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.651557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d1dd-58bb-499b-9b74-b8f89d2f49ff None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.652045 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d1dd-58bb-499b-9b74-b8f89d2f49ff None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.653424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d1dd-58bb-499b-9b74-b8f89d2f49ff None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:53.655114 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d1dd-58bb-499b-9b74-b8f89d2f49ff None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:53.657415 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 60/115] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:53 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:53.663116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:53.801362 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93228-0510-42b4-94ce-654cf467b0eb None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:53.847521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fbac7-77c0-4c0e-8181-72fb9bf6195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:53.848233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fbac7-77c0-4c0e-8181-72fb9bf6195c None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.848520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fbac7-77c0-4c0e-8181-72fb9bf6195c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.848799 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fbac7-77c0-4c0e-8181-72fb9bf6195c None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/a5621789b9f4468f90a50f03b6178b3f/roles/068868605675478a8abe0ef53a447f78` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.856312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fbac7-77c0-4c0e-8181-72fb9bf6195c None admin] RBAC: Authorizing `identity:create_grant(project_id=d89c05fc0e264ac88dc1802f4a1fb473, user_id=a5621789b9f4468f90a50f03b6178b3f, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:53.857845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fbac7-77c0-4c0e-8181-72fb9bf6195c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:53.865270 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:53.874389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081b9b5-d78f-4cbe-8c39-056dbf1489cf None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.874962 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081b9b5-d78f-4cbe-8c39-056dbf1489cf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.875416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081b9b5-d78f-4cbe-8c39-056dbf1489cf None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.877253 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 61/116] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:53.882727 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4b02-a279-406d-8c56-0e6253e46069 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:53.883247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4b02-a279-406d-8c56-0e6253e46069 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:53.884712 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4b02-a279-406d-8c56-0e6253e46069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:53.890952 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 56/117] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:42:53 2022] PUT /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/a5621789b9f4468f90a50f03b6178b3f/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:42:53.914902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-4e1a4b02-a279-406d-8c56-0e6253e46069 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:53.916501 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-4e1a4b02-a279-406d-8c56-0e6253e46069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:53.995130 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 62/118] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:54.007498 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae7d6-aafc-4ad7-9350-ae6e43df4633 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.007819 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae7d6-aafc-4ad7-9350-ae6e43df4633 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.008070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae7d6-aafc-4ad7-9350-ae6e43df4633 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.009571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 57/119] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:54.015326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39654b-17d7-409f-936e-335c884f0610 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.015999 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39654b-17d7-409f-936e-335c884f0610 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.016488 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39654b-17d7-409f-936e-335c884f0610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.026787 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:54.037833 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae7d6-aafc-4ad7-9350-ae6e43df4633 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.039448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-7c39654b-17d7-409f-936e-335c884f0610 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:54.041788 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-7c39654b-17d7-409f-936e-335c884f0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:54.118056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 63/120] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:54.119472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0dc28-ec39-40cb-a4a1-e96356ca95fa None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.119786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0dc28-ec39-40cb-a4a1-e96356ca95fa None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.120066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0dc28-ec39-40cb-a4a1-e96356ca95fa None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.121415 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 64/121] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:54.126848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.127180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.127462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.159967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:54.161225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:54.242888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 65/122] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:54.243862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.248035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae7d6-aafc-4ad7-9350-ae6e43df4633 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.293329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.294376 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.294823 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.295298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.308805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:54.315510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:54.316440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:54.317265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:54.319480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:54.321295 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 58/123] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:54.327186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.367158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b3ebd-dc90-48f4-ba52-f4c101fd9164 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.402036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:54.411050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.411712 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.411998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.412283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.424254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:54.429337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:54.430204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:54.431004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 66/124] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:54.431691 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.472006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3d906-dda5-4ac2-8629-632b7bc7a6c3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.522681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.523688 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.524171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.524641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.539793 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:54.547641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:54.548568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:54.549347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:54.551531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 59/125] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:54.552487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.571235 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d9830-eacc-4637-b9c1-4202ffbde6ca None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.633653 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:54.657995 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.658688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.659321 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.659551 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.660455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:54.660784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:54.662161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:54.679555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793cb2c-41ef-47dd-a70e-26f2bf01e0fa None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.684153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 67/126] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:54.687045 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.707270 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:54.723519 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.724778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.725687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.726172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.727127 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:54.727698 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:54.729866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:54.739015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 60/127] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:54.740343 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.856079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f500b-a6de-49e0-8ee0-b409207a5d93 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.868388 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9649a7-801f-46b1-9080-5877c6ef8398 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:54.893048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.894103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.894602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.895205 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.897014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:54.898782 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:54.901306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 61/128] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:54.902511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.937135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:54.937770 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:54.938120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:54.938319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:54.939071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:54.939392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:54.940780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:54.959774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 68/129] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:54.960940 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:54.987307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:55.064859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:55.085702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c2b2d-8d33-42b5-be1d-4eba84b73c9a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.149260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29921c3-38e8-4c7d-834b-af065e89b6a2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.163289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.164260 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.164746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.165225 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.167030 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.170201 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.172243 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 62/130] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:55.174416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:55.218583 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.219270 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.219556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.219832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.222498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.224128 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.226050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 69/131] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:54 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:55.226674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:55.299212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328d66-ee03-4b40-8d98-c643de5305b1 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.315271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:55.336842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.337830 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.338346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.338815 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.340210 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.341792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.343844 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 63/132] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:55 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:55.349253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:55.406943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252097f-9834-4e7f-b555-a834b95274ad None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.442738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:55.455444 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862dec9-1617-477c-bbdc-6b481a630194 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.488217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.488887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.489159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.489440 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.495744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.497218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.498905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 70/133] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:55 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:55.499691 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:55.503244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.504203 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.504665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.505242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/03092f47767a46b399baeb618ef35c79/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.507600 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] RBAC: Authorizing `identity:create_grant(project_id=d89c05fc0e264ac88dc1802f4a1fb473, user_id=03092f47767a46b399baeb618ef35c79, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.509269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.531694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:42:55 2022] PUT /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/03092f47767a46b399baeb618ef35c79/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:42:55.533040 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:55.646530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:55.738390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e1814-d82f-4d46-9aba-5c6222328edc None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.756105 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24ae23-dad3-46e3-817a-32f71642a9bd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:55.795446 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e73f5-fc7e-4eba-87bb-f2010a3ee5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.796302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e73f5-fc7e-4eba-87bb-f2010a3ee5c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.796611 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e73f5-fc7e-4eba-87bb-f2010a3ee5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.796996 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e73f5-fc7e-4eba-87bb-f2010a3ee5c7 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/03092f47767a46b399baeb618ef35c79/roles/d037ce24b27049d4a04b921a2fe5ec8e` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.799450 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e73f5-fc7e-4eba-87bb-f2010a3ee5c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89c05fc0e264ac88dc1802f4a1fb473, user_id=03092f47767a46b399baeb618ef35c79, role_id=d037ce24b27049d4a04b921a2fe5ec8e)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.802265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e73f5-fc7e-4eba-87bb-f2010a3ee5c7 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.818326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 65/135] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:42:55 2022] PUT /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/03092f47767a46b399baeb618ef35c79/roles/d037ce24b27049d4a04b921a2fe5ec8e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:42:55.820298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bab60-26da-4cf4-83d2-c5effba694d8 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.820748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bab60-26da-4cf4-83d2-c5effba694d8 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.821189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bab60-26da-4cf4-83d2-c5effba694d8 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.823387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:55.823559 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 66/136] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:55.824764 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.828661 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.829158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] PATH_INFO: `/v3/projects/caca8da6ea064104bfa4cebe5b56e524` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.829969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:55.830412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:55.830761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:55.831259 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] RBAC: Authorizing `identity:get_project(project_id=caca8da6ea064104bfa4cebe5b56e524)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:55.832961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:55.834835 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 71/137] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:55 2022] GET /identity/v3/projects/caca8da6ea064104bfa4cebe5b56e524 => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:55.850587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:55.859211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:55.861826 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:55.948086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 67/138] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:55.970986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:55.990648 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:56.033008 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:56.042535 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b157ba1-c4a0-40cd-8932-5eb176261a07 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:56.081106 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:56.082117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.082596 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.083090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] PATH_INFO: `/v3/projects/caca8da6ea064104bfa4cebe5b56e524/users/03092f47767a46b399baeb618ef35c79/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.088582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] RBAC: Authorizing `identity:create_grant(project_id=caca8da6ea064104bfa4cebe5b56e524, user_id=03092f47767a46b399baeb618ef35c79, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:56.091723 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:56.112811 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:42:55 2022] PUT /identity/v3/projects/caca8da6ea064104bfa4cebe5b56e524/users/03092f47767a46b399baeb618ef35c79/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:42:56.137548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526f8df-7e53-4f5a-b82c-339c8c17d74f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:56.180500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bda5b-d117-4f6e-ad23-9f125426bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:56.181495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bda5b-d117-4f6e-ad23-9f125426bb62 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.182094 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bda5b-d117-4f6e-ad23-9f125426bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.182718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bda5b-d117-4f6e-ad23-9f125426bb62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.185216 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bda5b-d117-4f6e-ad23-9f125426bb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:56.187378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bda5b-d117-4f6e-ad23-9f125426bb62 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:56.190107 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 68/140] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:56.195993 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:56.319681 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44229b-d0a7-4503-a80a-a3b777c3059f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:56.334755 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:56.366325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f2b7-ac3f-4580-8520-eaf10b498aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:56.367356 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f2b7-ac3f-4580-8520-eaf10b498aa5 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.367817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f2b7-ac3f-4580-8520-eaf10b498aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.368266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f2b7-ac3f-4580-8520-eaf10b498aa5 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.369182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f2b7-ac3f-4580-8520-eaf10b498aa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:56.370946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f2b7-ac3f-4580-8520-eaf10b498aa5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:56.418032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 73/141] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:42:56 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:42:56.442137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184030e-eb0f-4c47-b607-95784e282c7b None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.443096 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184030e-eb0f-4c47-b607-95784e282c7b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.443555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184030e-eb0f-4c47-b607-95784e282c7b None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.445141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 69/142] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:56.452095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.452646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.453096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.474977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:56.475557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:56.561490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 74/143] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:56.601425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184030e-eb0f-4c47-b607-95784e282c7b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:56.724015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:56.727848 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184030e-eb0f-4c47-b607-95784e282c7b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:56.763582 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:56.764237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.764514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.764786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.776882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:56.781725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:56.782565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:56.783691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 70/144] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:56.788954 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:56.903028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:56.907736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ba669-1281-4687-86b7-a0403ae89f21 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:56.950972 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:56.952176 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:56.952650 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:56.953133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:56.954071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:56.954591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:56.956233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e817de8-ad43-4f3e-85de-baf15406b39e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:56.966035 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 75/145] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:56.972084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:57.123773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d76997-5a6b-459b-926b-4e7fd2cd11cd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:57.143459 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448e041-9625-4e3b-98e1-45878e3414c4 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.144093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448e041-9625-4e3b-98e1-45878e3414c4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.144606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448e041-9625-4e3b-98e1-45878e3414c4 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.146242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 76/146] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:57.151851 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.152425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.152911 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.173492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:57.173492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.173755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.173965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] PATH_INFO: `/v3/users/579fb59bdd624ecaae8deb09a7b95ee9` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.175220 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] RBAC: Authorizing `identity:get_user(user_id=579fb59bdd624ecaae8deb09a7b95ee9)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:57.176667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:57.178259 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 71/147] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:56 2022] GET /identity/v3/users/579fb59bdd624ecaae8deb09a7b95ee9 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:57.183785 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:57.203953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:57.205140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:57.225842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:57.310763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb694f24-d06e-433a-b97c-84fc16c7897a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:57.360309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 77/148] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:42:57.370972 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:57.371647 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.371926 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.372199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.373878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:57.375349 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:57.377024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 72/149] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:57 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:42:57.382947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:57.399954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:57.553948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:57.563761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:57.573776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930a336-d7cd-4b22-82d1-ca3ed841d38a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:57.578363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c91c89-f0a7-40b0-b9f4-bb180fbbc7d5 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:57.626138 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:57.627249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.627844 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.628322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.631008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:57.631804 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.632090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.632363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/579fb59bdd624ecaae8deb09a7b95ee9/roles/2e79002ba27647eb8ccda5f9f6ab43bc` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.637969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] RBAC: Authorizing `identity:create_grant(project_id=d89c05fc0e264ac88dc1802f4a1fb473, user_id=579fb59bdd624ecaae8deb09a7b95ee9, role_id=2e79002ba27647eb8ccda5f9f6ab43bc)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:57.639499 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:57.646757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:57.652818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:57.653760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:42:57.654538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:42:57.656922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 73/150] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:42:57.663386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:57.674657 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 78/151] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:42:57 2022] PUT /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/users/579fb59bdd624ecaae8deb09a7b95ee9/roles/2e79002ba27647eb8ccda5f9f6ab43bc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:42:57.788661 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee12ee-ad7d-447a-8379-52541537da57 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:57.843845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:57.844501 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:57.844838 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:57.845056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:57.845793 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:57.846097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:57.847551 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:57.859253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 74/152] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:57.864748 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:57.981910 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f561-027d-478a-b5e9-be5a68e58e1f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:58.022474 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:58.023213 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:58.023487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:58.023758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] PATH_INFO: `/v3/users/a5621789b9f4468f90a50f03b6178b3f` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:58.025021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] RBAC: Authorizing `identity:get_user(user_id=a5621789b9f4468f90a50f03b6178b3f)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:58.026508 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:58.028353 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 79/153] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:57 2022] GET /identity/v3/users/a5621789b9f4468f90a50f03b6178b3f => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:58.034055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:58.068265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:58.161388 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb761-aa3c-479f-a5c7-d8b5971c7eca None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:58.198544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:58.199199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:58.199479 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:58.199747 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:58.277035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:58.278518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:58.301722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:58.391399 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 75/154] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:42:58.396519 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:58.426694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:58.550557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49b2d-e53f-41f2-bcdc-21d461ef1390 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:58.590972 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775439b-21c5-413b-9618-35c7a6b65949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:58.591628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775439b-21c5-413b-9618-35c7a6b65949 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:58.591906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775439b-21c5-413b-9618-35c7a6b65949 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:58.592179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775439b-21c5-413b-9618-35c7a6b65949 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:58.595642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775439b-21c5-413b-9618-35c7a6b65949 None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:58.597102 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775439b-21c5-413b-9618-35c7a6b65949 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:58.598810 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 80/155] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:42:58 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:58.605297 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:58.734464 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16de1-9da1-4517-aaad-a904936b3429 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:58.755486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:58.777594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:58.778219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:58.778497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:58.778772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:58.779599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=a5621789b9f4468f90a50f03b6178b3f) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:58.779904 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:58.781340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196a2a4-dae0-4306-99da-38658913a96f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:58.792381 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 76/156] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:42:58 2022] GET /identity/v3/role_assignments?user.id=a5621789b9f4468f90a50f03b6178b3f&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=068868605675478a8abe0ef53a447f78 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:59.132226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275bd8e-f650-4c94-a389-022c2470b946 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.132729 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275bd8e-f650-4c94-a389-022c2470b946 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.132729 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275bd8e-f650-4c94-a389-022c2470b946 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.134277 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 81/157] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:42:59.153227 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.153551 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.153775 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.183932 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:59.185134 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:59.276926 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 77/158] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:59.317833 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275bd8e-f650-4c94-a389-022c2470b946 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:59.418895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:59.436389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275bd8e-f650-4c94-a389-022c2470b946 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:59.478970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc280-002d-4396-bfa0-d182a2ba6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:59.479633 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc280-002d-4396-bfa0-d182a2ba6c57 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.479909 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc280-002d-4396-bfa0-d182a2ba6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.480180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc280-002d-4396-bfa0-d182a2ba6c57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.498635 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc280-002d-4396-bfa0-d182a2ba6c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-328fc280-002d-4396-bfa0-d182a2ba6c57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:42:59.503610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:42:59.504473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:42:59.505311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 82/159] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:42:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:42:59.512073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:59.622570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87261276-bae1-4c39-99cc-cd921baeb96d None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:59.638410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:59.665174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:59.665852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.666162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.666463 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.667202 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:42:59.667502 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:59.668993 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:59.676218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a4e9-1aa8-4e79-bfb1-18613b0a07bb None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.676504 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a4e9-1aa8-4e79-bfb1-18613b0a07bb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.676779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a4e9-1aa8-4e79-bfb1-18613b0a07bb None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.678667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 83/160] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:42:59.684221 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 78/161] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:59.690711 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.691020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.691296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.698333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:59.719961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:42:59.721154 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:42:59.838713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 84/162] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:42:59.876062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:42:59.878515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99317967-c9a7-433f-a088-24fe804e8202 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:42:59.944610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:42:59.945280 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:42:59.945717 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:42:59.946124 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:42:59.948020 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:42:59.949610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:42:59.951599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 79/163] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:42:59 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:42:59.962955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:00.020663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:00.050537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:00.059413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9c17c-bbb6-406d-a7f1-cd7dd29e191e None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.127575 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:00.128497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:00.128913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:00.129322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:00.142192 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fc25-1e0a-4b67-9fd7-40c9e0a99131 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.151787 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:00.156665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:00.157514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:00.158564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 85/164] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:00.164560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:00.202772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:00.203340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:00.203917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:00.204370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:00.311247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2925-af48-426d-b95a-f01ace24657a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.332449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:00.333939 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:00.352588 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:00.353587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:00.354092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:00.354556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:00.355491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:00.355984 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:00.357850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:00.366724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 86/165] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:00.367243 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:00.373000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:00.431266 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:00.537442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 80/166] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:43:00.540190 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf513-7691-4086-b3e5-3c0abfd07a1d None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.552492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:00.599742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:00.600392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:00.600665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:00.600938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:00.602085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:00.603558 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:00.605964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 87/167] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:00 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:00.611774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:00.689513 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e2363-ce8e-4d87-899d-8e66d67da7eb None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.752565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:00.753150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:00.753431 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:00.753700 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:00.760366 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:00.761999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:00.764160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 81/168] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:00 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:00.770104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:00.779411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:00.787923 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:00.897697 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417aa3-5b01-43ec-b32c-58eb4fa5b03c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.948075 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2fe50-c673-4c77-82a4-3edf78a00b4f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:00.992591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651d1d8-665a-4bf7-bf00-9a7e6ff9e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:00.993254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651d1d8-665a-4bf7-bf00-9a7e6ff9e99c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:00.993518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651d1d8-665a-4bf7-bf00-9a7e6ff9e99c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:00.993797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651d1d8-665a-4bf7-bf00-9a7e6ff9e99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.020659 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:01.021640 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.021918 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.022190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.023337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=03092f47767a46b399baeb618ef35c79) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:01.023790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:01.025299 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:01.043739 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 82/169] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:00 2022] GET /identity/v3/role_assignments?user.id=03092f47767a46b399baeb618ef35c79&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:01.142383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651d1d8-665a-4bf7-bf00-9a7e6ff9e99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:01.143914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651d1d8-665a-4bf7-bf00-9a7e6ff9e99c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:01.217175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:01.264068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 88/170] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:01.269751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:01.374435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:01.375486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fc4d2-eaec-43bb-a75a-bbf49719ac3c None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.376015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fc4d2-eaec-43bb-a75a-bbf49719ac3c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.376513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fc4d2-eaec-43bb-a75a-bbf49719ac3c None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.378069 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 89/171] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:01.390969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.391618 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.392090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.426556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:01.433226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:01.437116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea93b4-ee25-4c09-b2eb-f5c446b650e8 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:01.506520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:01.507206 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.507485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.507760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.511033 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:01.513663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:01.515554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 83/172] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:01 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:01.522722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:01.579971 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 90/173] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:01.626986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:01.645973 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808553-4332-4a67-a605-46cd6f27a529 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:01.690188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:01.690805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.691119 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.691396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.692704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] RBAC: Adding query filter params (role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=03092f47767a46b399baeb618ef35c79) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:01.693024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:01.694483 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483777e6-e1ef-4005-b8de-161e562105bb None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:01.701807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 84/174] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:01 2022] GET /identity/v3/role_assignments?user.id=03092f47767a46b399baeb618ef35c79&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:01.817844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:01.830185 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c3b9-5186-4897-b92a-a712d7ab92a8 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:01.878822 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58129427-204b-4e96-b998-ed8361084b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:01.879439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58129427-204b-4e96-b998-ed8361084b3f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.879728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58129427-204b-4e96-b998-ed8361084b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.880054 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58129427-204b-4e96-b998-ed8361084b3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.881864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f105c-4bdc-4bda-b517-461c72eef545 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.882166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f105c-4bdc-4bda-b517-461c72eef545 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.882449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f105c-4bdc-4bda-b517-461c72eef545 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.885535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 85/175] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:01.889879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa90ff1-6e07-4cca-ad76-84b1997b897e None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.890442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa90ff1-6e07-4cca-ad76-84b1997b897e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.890934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa90ff1-6e07-4cca-ad76-84b1997b897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.898252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58129427-204b-4e96-b998-ed8361084b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:01.908344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-58129427-204b-4e96-b998-ed8361084b3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:01.909200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:01.910384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:01.911590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 91/176] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:01.912434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03505a-fced-46fb-8306-71e8feb4d093 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:01.912513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03505a-fced-46fb-8306-71e8feb4d093 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:01.913948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03505a-fced-46fb-8306-71e8feb4d093 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:01.914069 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 92/177] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:01.919999 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03505a-fced-46fb-8306-71e8feb4d093 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:01.927144 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-0fa90ff1-6e07-4cca-ad76-84b1997b897e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:01.928567 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-0fa90ff1-6e07-4cca-ad76-84b1997b897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:02.033786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 86/178] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:02.034878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951e67-272a-4ba4-a98b-714776806fec None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.036042 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951e67-272a-4ba4-a98b-714776806fec None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.036316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee951e67-272a-4ba4-a98b-714776806fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.054588 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-ee951e67-272a-4ba4-a98b-714776806fec None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:02.055804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-ee951e67-272a-4ba4-a98b-714776806fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:02.088071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03505a-fced-46fb-8306-71e8feb4d093 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.136838 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.137539 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.137755 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.138034 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.138758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:02.139921 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 87/179] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:02.140971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745e7a2-7cd7-49f8-bd9c-d64668b56876 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.141249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745e7a2-7cd7-49f8-bd9c-d64668b56876 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.141521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745e7a2-7cd7-49f8-bd9c-d64668b56876 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.142751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 88/180] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:02.143226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:02.143461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745e7a2-7cd7-49f8-bd9c-d64668b56876 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.145321 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f0cb3-22b1-42a8-a6c6-6677252e0d94 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:02.157638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 93/181] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:02.160446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.161224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.161697 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.187219 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:02.188449 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:02.205469 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.224559 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.269040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 94/182] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:02.269886 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.281090 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745e7a2-7cd7-49f8-bd9c-d64668b56876 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.321758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.322981 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.323466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.323992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.334683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:02.340333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:02.341274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:02.342080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 89/183] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:02.342748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.386631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68c26-4829-4562-9d65-d76c33307066 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.425169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.425739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.426022 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.426296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] PATH_INFO: `/v3/users/03092f47767a46b399baeb618ef35c79` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.427500 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] RBAC: Authorizing `identity:get_user(user_id=03092f47767a46b399baeb618ef35c79)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:02.428969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:02.430589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 95/184] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/users/03092f47767a46b399baeb618ef35c79 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:02.431376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.453420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.462220 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8d1f7-c5f3-4981-8732-1d9bd71ca060 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.494182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.504661 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.505306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.505585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.505858 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.516646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:02.521574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:02.522493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 90/185] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:02.524045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.552967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0880c96-d3c7-4921-a4ba-aee6492950ec None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.587724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.588395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.588672 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.588943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.599110 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:02.603968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:02.605042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 96/186] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:02.605902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.627272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ebaa-2b32-4766-a12c-a2958d66237b None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.659861 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.660472 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.660745 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.661024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.661722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:02.662020 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:02.663424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:02.671131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 91/187] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:02.671131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.682425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.705817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbc7f3-f623-459e-a61f-29b7efb8e427 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.729660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.741116 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.741734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.742009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.742286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.782759 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a8513-0037-4ba7-8559-f7796570c442 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.810258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:02.811741 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:02.815294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.815915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.816197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.816472 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.817178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:02.817481 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:02.818846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a270e-deeb-43d3-a698-e5cca6232975 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:02.827274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 92/188] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:02.827274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b77a7-88da-4b59-b11f-b97792a50cfa None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.827274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b77a7-88da-4b59-b11f-b97792a50cfa None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.827274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b77a7-88da-4b59-b11f-b97792a50cfa None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.827274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 93/189] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:02.827274 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b77a7-88da-4b59-b11f-b97792a50cfa None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.891782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.915699 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 97/190] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:02.917068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:02.937565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b77a7-88da-4b59-b11f-b97792a50cfa None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:02.948410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:02.972018 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:02.972625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:02.972899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:02.973175 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:02.973873 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:02.974169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:02.975569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:02.983733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 94/191] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:02.984497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.013998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8e7d-ba0a-45ca-b699-1481019b2987 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.050368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.050751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.051057 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.051322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] PATH_INFO: `/v3/users/525d30e38e47469bb36a051ed8e06a2e` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.089131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e05bc-ae65-43a5-b136-9713bce1acd4 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.126324 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8dd8e-dd5e-4ff9-8335-6d77af7ec9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.127015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dd8e-dd5e-4ff9-8335-6d77af7ec9db None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.127293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dd8e-dd5e-4ff9-8335-6d77af7ec9db None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.127560 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dd8e-dd5e-4ff9-8335-6d77af7ec9db None admin] PATH_INFO: `/v3/users/525d30e38e47469bb36a051ed8e06a2e` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.142354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8dd8e-dd5e-4ff9-8335-6d77af7ec9db None admin] RBAC: Authorizing `identity:get_user(user_id=525d30e38e47469bb36a051ed8e06a2e)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.143875 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8dd8e-dd5e-4ff9-8335-6d77af7ec9db None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.145608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/users/525d30e38e47469bb36a051ed8e06a2e => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:03.146796 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.147099 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.147370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.165593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:03.167322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:03.181407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] RBAC: Authorizing `identity:get_user(user_id=525d30e38e47469bb36a051ed8e06a2e)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.183481 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.185319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 98/193] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:02 2022] GET /identity/v3/users/525d30e38e47469bb36a051ed8e06a2e => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:03.185995 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.191914 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.221419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.236444 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 96/194] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:03.251109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.288991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f413f1-f722-4428-91c1-50de35cb22be None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.321982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.322668 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.322967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.323243 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] PATH_INFO: `/v3/projects/caca8da6ea064104bfa4cebe5b56e524` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.324388 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=caca8da6ea064104bfa4cebe5b56e524)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.325815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.327507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 99/195] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/projects/caca8da6ea064104bfa4cebe5b56e524 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:03.328293 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.350520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb995a8-6257-4dce-b98a-2bc19e899e5e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.384238 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.384933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.385217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.385491 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] PATH_INFO: `/v3/users/579fb59bdd624ecaae8deb09a7b95ee9` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.386653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] RBAC: Authorizing `identity:get_user(user_id=579fb59bdd624ecaae8deb09a7b95ee9)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.388185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.389790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 97/196] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/users/579fb59bdd624ecaae8deb09a7b95ee9 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:03.390545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.419726 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.431494 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40327a-6ab9-4f8e-9b20-c9566dd1d6f2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.433032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.466059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.466620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.466906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.467210 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.491305 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f659556-6390-4057-9ab2-5b8e64c9e503 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.527343 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.527957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.528232 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.528496 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.536026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.537526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.596100 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.597784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.624251 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.634132 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 100/197] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:03.635025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.637180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.698080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 98/198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:03.699850 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.733337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73b23f-4de5-4adb-a2bd-df740f531d42 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.766286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.766926 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.767224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.767496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.768635 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.770065 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.771667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:03.773888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.796293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c067191-54cd-4292-982c-49dc9ef5236d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.821940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.830653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.831302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.831587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.831855 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.832630 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=caca8da6ea064104bfa4cebe5b56e524, user.id=03092f47767a46b399baeb618ef35c79) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:03.832930 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:03.834360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:03.839980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 99/200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/role_assignments?user.id=03092f47767a46b399baeb618ef35c79&scope.project.id=caca8da6ea064104bfa4cebe5b56e524&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:03.840744 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:03.842680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:03.882676 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82af4e-4f43-4c93-9ef0-76b1db6754f6 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:03.920364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:03.921384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:03.921855 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:03.922324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:03.973682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e0fcc-d088-4e25-939a-22314c0d3952 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.000140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.001713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.009912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.011267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.011546 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.011815 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.012987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.014427 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.016396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:04.017160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:04.085805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:04.089350 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:04.118471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 102/202] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:04.124091 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:04.133173 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f7871-6df9-493d-a2c5-784c40cffcd3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.167030 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.167670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.167948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.168218 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.169393 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.170836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.172506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 101/203] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:04 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:04.173257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:04.224031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f521b8-c422-4124-a18c-1d1b98c7ddf4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.256831 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.257374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.257658 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.257923 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.258601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.260203 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.269187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061d8ae-cb8f-4248-a30e-e372bccaed7d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.285902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 103/204] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:04 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:04.299496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:04.317795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:04.318000 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:04.328738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.329414 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.329648 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.329917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.330746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] RBAC: Adding query filter params (role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=525d30e38e47469bb36a051ed8e06a2e) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:04.331086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.332547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.339911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 102/205] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:04 2022] GET /identity/v3/role_assignments?user.id=525d30e38e47469bb36a051ed8e06a2e&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:04.341169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:04.418826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6478636-a092-417f-b9dd-8c7f4c38fbd5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.466693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.467845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.468360 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.468837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.470349 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.475175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.477351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 104/206] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:04 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:04.483592 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:04.517683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68f468-21f5-4f5e-8be8-28919e4ef20d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.567320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.568414 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.569547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.570252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.571511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=525d30e38e47469bb36a051ed8e06a2e) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:04.571983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.573634 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167352d3-ef9b-4db9-8860-2b39272776ea None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.581091 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 103/207] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:04 2022] GET /identity/v3/role_assignments?user.id=525d30e38e47469bb36a051ed8e06a2e&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=068868605675478a8abe0ef53a447f78 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:04.617114 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:04.625346 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacf444-e841-4c50-a6bd-ee61ed74540e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:04.676132 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:04.676781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:04.677059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:04.677333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:04.678147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] RBAC: Adding query filter params (role.id=2e79002ba27647eb8ccda5f9f6ab43bc, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473, user.id=579fb59bdd624ecaae8deb09a7b95ee9) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:04.678458 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:04.679996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdfdec-db20-4eb9-9b13-20257e23dc25 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:04.688520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 105/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:04 2022] GET /identity/v3/role_assignments?user.id=579fb59bdd624ecaae8deb09a7b95ee9&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=2e79002ba27647eb8ccda5f9f6ab43bc => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:06.683290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d791a-cd14-47c8-9ebd-738c6c9583d4 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.683805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d791a-cd14-47c8-9ebd-738c6c9583d4 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.683887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d791a-cd14-47c8-9ebd-738c6c9583d4 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.685221 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 104/209] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:06.690487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bbf7b-d8c5-4604-b114-fb9b7b8bfb3f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.691311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bbf7b-d8c5-4604-b114-fb9b7b8bfb3f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.691811 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bbf7b-d8c5-4604-b114-fb9b7b8bfb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.711383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c97bbf7b-d8c5-4604-b114-fb9b7b8bfb3f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:06.712987 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c97bbf7b-d8c5-4604-b114-fb9b7b8bfb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:06.795325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 106/210] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:06.815442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d791a-cd14-47c8-9ebd-738c6c9583d4 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:06.878214 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:06.899370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef60149-67d7-461e-b2d7-4b135ce332df None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.899370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef60149-67d7-461e-b2d7-4b135ce332df None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.899370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef60149-67d7-461e-b2d7-4b135ce332df None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.899687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 107/211] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:06.906360 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc789-91c5-4c0c-baa3-715939d10e47 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.906970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc789-91c5-4c0c-baa3-715939d10e47 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.907452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddc789-91c5-4c0c-baa3-715939d10e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.928239 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-67ddc789-91c5-4c0c-baa3-715939d10e47 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:06.929007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d791a-cd14-47c8-9ebd-738c6c9583d4 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:06.929410 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-67ddc789-91c5-4c0c-baa3-715939d10e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:06.964670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dcabe-91af-40d9-b9a1-7eb91e6c3c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:06.965311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dcabe-91af-40d9-b9a1-7eb91e6c3c4d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.965587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dcabe-91af-40d9-b9a1-7eb91e6c3c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.965857 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dcabe-91af-40d9-b9a1-7eb91e6c3c4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.976364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dcabe-91af-40d9-b9a1-7eb91e6c3c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-ca7dcabe-91af-40d9-b9a1-7eb91e6c3c4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:06.981641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:06.982602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:06.983639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 105/212] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:06.988591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d7f5-56a1-40e3-a76a-6e45f9a65cda None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.988959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d7f5-56a1-40e3-a76a-6e45f9a65cda None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.989304 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d7f5-56a1-40e3-a76a-6e45f9a65cda None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.990651 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 106/213] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:06.991699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b4a8-4375-4a29-b73f-815150b2269c None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:06.991979 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b4a8-4375-4a29-b73f-815150b2269c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:06.992250 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b4a8-4375-4a29-b73f-815150b2269c None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:06.993425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 107/214] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:06.995057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b4a8-4375-4a29-b73f-815150b2269c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.012722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 108/215] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:07.014410 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec3c4-6c22-47a7-88b0-315374897aa3 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.014694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec3c4-6c22-47a7-88b0-315374897aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.015177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec3c4-6c22-47a7-88b0-315374897aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.031925 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-1bfec3c4-6c22-47a7-88b0-315374897aa3 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:07.033329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-1bfec3c4-6c22-47a7-88b0-315374897aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:07.046365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.099817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 109/216] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:07.101168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.101519 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.101859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.106711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b4a8-4375-4a29-b73f-815150b2269c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.122762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:07.123983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:07.126141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.145733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.146356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.146636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.146907 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.147641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:07.147953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.149321 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.157025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 108/217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.157798 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.190517 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 110/218] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:07.191355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.257249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23bd9f-922c-430a-8d95-d01d4938dc23 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.270844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.290631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.291453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.291730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.291998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.293075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ba99-21ec-43f0-a19b-09005ae846bf None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.301855 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:07.307537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:07.308424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:07.309252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 109/219] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:07.310156 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.331884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.332549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.332828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.333100 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.334236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.335707 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.337290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 111/220] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.338088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.351294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.410250 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc82c3-deef-497c-b5ac-6dd1958bd8f0 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.434439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a459b48-a3bf-4ff4-bf86-b70058cfeb22 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.442713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.443387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.443667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.443944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] PATH_INFO: `/v3/users/525d30e38e47469bb36a051ed8e06a2e` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.445103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] RBAC: Authorizing `identity:get_user(user_id=525d30e38e47469bb36a051ed8e06a2e)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.446565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.448882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 110/221] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/users/525d30e38e47469bb36a051ed8e06a2e => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.449477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.467832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.468503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.468806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.471461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.481615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:07.486491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:07.487411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:07.488200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 112/222] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:07.489272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.500766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.554031 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19529-037c-4244-b2c6-beaeadaee356 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.560703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.588697 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.589318 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.589594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.589866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.590568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:07.590869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.592273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.595038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12485-5e0a-4a85-a79e-f737bf63e37e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.600190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.601006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.631902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.632518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.632797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.633078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.633756 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.635779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.656767 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 113/224] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:07 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:07.667200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.715271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab5480-0307-4683-bec9-dbff1151176a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.748621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.759285 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.761680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.762110 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.762529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.764025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.766163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.773371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 112/225] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.773371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.799874 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f2dbb-a84b-48ab-995a-28c898ff9af9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.816889 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:07.843407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.844034 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.844311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.844579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.846084 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:07.846084 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.847744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.856272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 114/226] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.861949 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.893720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96af52-0659-4fbb-9ec9-6d164d0c9ed2 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:07.942441 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:07.943178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:07.943459 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:07.943726 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] PATH_INFO: `/v3/users/1896355e81f5433b8ff161e1c66513b2` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:07.962130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] RBAC: Authorizing `identity:get_user(user_id=1896355e81f5433b8ff161e1c66513b2)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:07.963710 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:07.969310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 113/227] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/users/1896355e81f5433b8ff161e1c66513b2 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:07.969310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:07.980513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c0b3d-dca2-48d6-8333-6b242e369f61 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:08.009250 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:08.026809 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:08.027778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:08.028233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:08.028663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd/users/525d30e38e47469bb36a051ed8e06a2e/roles/d037ce24b27049d4a04b921a2fe5ec8e` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:08.031577 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] RBAC: Authorizing `identity:create_grant(project_id=161f42e62554415799e108f3a19fcecd, user_id=525d30e38e47469bb36a051ed8e06a2e, role_id=d037ce24b27049d4a04b921a2fe5ec8e)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:08.033886 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:08.057623 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 115/228] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:07 2022] PUT /identity/v3/projects/161f42e62554415799e108f3a19fcecd/users/525d30e38e47469bb36a051ed8e06a2e/roles/d037ce24b27049d4a04b921a2fe5ec8e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:08.057623 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:08.095410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:08.107904 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251fd35-4d1e-465c-a123-696b9930b773 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:08.178454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:08.179206 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:08.179485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:08.179754 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] PATH_INFO: `/v3/users/525d30e38e47469bb36a051ed8e06a2e` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:08.181177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] RBAC: Authorizing `identity:get_user(user_id=525d30e38e47469bb36a051ed8e06a2e)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:08.185310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:08.195066 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 114/229] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:07 2022] GET /identity/v3/users/525d30e38e47469bb36a051ed8e06a2e => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:08.196086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:08.285438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bef8e-9b92-4d25-b379-2a6de5505325 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:08.328211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb50b4-fa4c-4298-8823-77afbd891448 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:08.337486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:08.338720 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:08.339028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:08.339299 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:08.378058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:08.378955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:08.379453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:08.379867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:08.381183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:08.382835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:08.385244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:08 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:08.391036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:08.404702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:08.431226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:08.432673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:08.432787 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:08.527966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c2055-4561-42fb-96aa-e6cdd3f3b4d3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:08.579620 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:08.580796 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:08.581084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:08.581621 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd/users/525d30e38e47469bb36a051ed8e06a2e/roles/068868605675478a8abe0ef53a447f78` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:08.584241 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] RBAC: Authorizing `identity:create_grant(project_id=161f42e62554415799e108f3a19fcecd, user_id=525d30e38e47469bb36a051ed8e06a2e, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:08.585726 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:08.619612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 116/231] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:08 2022] PUT /identity/v3/projects/161f42e62554415799e108f3a19fcecd/users/525d30e38e47469bb36a051ed8e06a2e/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:08.624654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:08.630579 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:08.757416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:08.771576 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32921505-a798-4f45-b821-f33362c4fb81 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:08.826401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cd390-f429-4e5f-8e24-43708043695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:08.827088 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cd390-f429-4e5f-8e24-43708043695f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:08.827412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cd390-f429-4e5f-8e24-43708043695f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:08.827694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cd390-f429-4e5f-8e24-43708043695f None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:08.828858 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cd390-f429-4e5f-8e24-43708043695f None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:08.830331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cd390-f429-4e5f-8e24-43708043695f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:08.832039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:08 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:08.838738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:08.958775 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:08.980718 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfde6e0-26c6-4a84-88ed-47d759dd358a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:09.019730 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:09.020708 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:09.021189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:09.021662 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:09.022677 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=1896355e81f5433b8ff161e1c66513b2) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:09.023288 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:09.024941 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e403ee-bf98-47fe-b941-61108f169364 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:09.036043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 117/234] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:08 2022] GET /identity/v3/role_assignments?user.id=1896355e81f5433b8ff161e1c66513b2&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:10.471525 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c3b10-9c63-4585-8380-57c37d32209f None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.472231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c3b10-9c63-4585-8380-57c37d32209f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.472231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c3b10-9c63-4585-8380-57c37d32209f None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.473417 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:10.479479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cea700-5338-43d1-b1af-9344ef96edc2 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.479930 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cea700-5338-43d1-b1af-9344ef96edc2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.480141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cea700-5338-43d1-b1af-9344ef96edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.508593 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-79cea700-5338-43d1-b1af-9344ef96edc2 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:10.509828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-79cea700-5338-43d1-b1af-9344ef96edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:10.582056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 118/236] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:10.606812 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c3b10-9c63-4585-8380-57c37d32209f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:10.611766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64373fae-7170-48f6-995e-49adfeb30466 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.612367 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64373fae-7170-48f6-995e-49adfeb30466 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.612869 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64373fae-7170-48f6-995e-49adfeb30466 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.614472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 119/237] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:10.620150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94362a52-b000-42f1-ad3e-9fec8ed74deb None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.620690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94362a52-b000-42f1-ad3e-9fec8ed74deb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.621173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94362a52-b000-42f1-ad3e-9fec8ed74deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.656037 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-94362a52-b000-42f1-ad3e-9fec8ed74deb None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:10.657572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-94362a52-b000-42f1-ad3e-9fec8ed74deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:10.728676 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c3b10-9c63-4585-8380-57c37d32209f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:10.772037 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 120/238] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:10.778979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f1d9-ceb0-426d-9632-e7473434f196 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.778979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f1d9-ceb0-426d-9632-e7473434f196 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.778979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f1d9-ceb0-426d-9632-e7473434f196 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.778979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 121/239] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:10.781815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.782141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.782426 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.789021 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:10.790028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.790495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.791030 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.801794 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:10.803295 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:10.805522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:10.815921 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:10.823662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:10.824558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:10.825363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:10.829327 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 119/240] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:10.830401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:10.863292 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:10.883203 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 122/241] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:10.884334 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:10.958541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d9576-9728-423b-a263-605c0e24be02 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:10.996075 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:10.997068 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:10.997537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:10.997995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:10.999466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.001103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.007423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 120/242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:11.008453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.027621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677585b-4b6e-4d2b-8b05-24ac34085c1d None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.075011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.075644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.075925 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.076201 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.077179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:11.077490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.079500 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.086754 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.095402 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 123/243] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:11.096213 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.106380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.132075 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abf03c-af24-4e7a-8dac-e6211ffee8f5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.185218 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.186223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.186685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.187235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.202587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:11.209934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:11.210856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:11.211733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:11.218163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 121/244] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:11.218163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.224359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2878a0-279c-4c6b-ad3b-9ef637c24c16 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.259366 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.260391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.260665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.260932 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.261610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.263107 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.286664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 124/245] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:11 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:11.291646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.352991 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178c9a0-38a9-4a8f-9111-46ef03020b18 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.400271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.409316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.410468 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.415493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.416593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] PATH_INFO: `/v3/users/d42826e41c65470b878b45e5652f07cc` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.450895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f029d-b538-4b64-bea3-9ed01859c8a9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.452189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] RBAC: Authorizing `identity:get_user(user_id=d42826e41c65470b878b45e5652f07cc)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.454813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.456818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 122/246] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/users/d42826e41c65470b878b45e5652f07cc => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:11.464098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.477593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.507977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.508689 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.508926 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.509200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.510800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:11.511112 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.512502 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.530238 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 125/247] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:11.538687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.611720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b30ca-f411-44f5-a5fc-4d9e1dc7310f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.664979 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51339a-f932-4669-8b26-ee54f5abd5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.665583 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51339a-f932-4669-8b26-ee54f5abd5b1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.665864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51339a-f932-4669-8b26-ee54f5abd5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.666254 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51339a-f932-4669-8b26-ee54f5abd5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.753937 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862ed57-ad11-4a0f-9940-3c750b97f89e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:11.761594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51339a-f932-4669-8b26-ee54f5abd5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.762388 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51339a-f932-4669-8b26-ee54f5abd5b1 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.776381 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.789946 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:11.799840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78476a-1d0a-47a6-99fb-76c47c0f9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:11.800506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78476a-1d0a-47a6-99fb-76c47c0f9505 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.800786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78476a-1d0a-47a6-99fb-76c47c0f9505 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.801062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78476a-1d0a-47a6-99fb-76c47c0f9505 None admin] PATH_INFO: `/v3/users/525d30e38e47469bb36a051ed8e06a2e` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.802271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78476a-1d0a-47a6-99fb-76c47c0f9505 None admin] RBAC: Authorizing `identity:get_user(user_id=525d30e38e47469bb36a051ed8e06a2e)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:11.803827 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78476a-1d0a-47a6-99fb-76c47c0f9505 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:11.807252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 126/248] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/users/525d30e38e47469bb36a051ed8e06a2e => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:11.809571 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d9294-0dbb-47d7-9b89-320e52065a10 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.809865 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d9294-0dbb-47d7-9b89-320e52065a10 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.810142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d9294-0dbb-47d7-9b89-320e52065a10 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.811565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 127/249] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:11.815953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d9294-0dbb-47d7-9b89-320e52065a10 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:11.919581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 123/250] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:11.920863 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0da0-527e-4259-b7b5-dacfbedd6288 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:11.921150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0da0-527e-4259-b7b5-dacfbedd6288 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:11.921508 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0da0-527e-4259-b7b5-dacfbedd6288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:11.944597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-adfe0da0-527e-4259-b7b5-dacfbedd6288 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:11.946241 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-adfe0da0-527e-4259-b7b5-dacfbedd6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:11.962325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d9294-0dbb-47d7-9b89-320e52065a10 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.001969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488c032-a75b-4603-9c87-9c8b2a8ad898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.002598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c032-a75b-4603-9c87-9c8b2a8ad898 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.002877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c032-a75b-4603-9c87-9c8b2a8ad898 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.003188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488c032-a75b-4603-9c87-9c8b2a8ad898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.027704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 124/251] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:12.028889 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af0c0-a858-4e90-99f2-69e90ce65614 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.029174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af0c0-a858-4e90-99f2-69e90ce65614 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.029446 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af0c0-a858-4e90-99f2-69e90ce65614 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.030849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 125/252] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:12.031403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af0c0-a858-4e90-99f2-69e90ce65614 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.080560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:12.096447 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c032-a75b-4603-9c87-9c8b2a8ad898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:12.098141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488c032-a75b-4603-9c87-9c8b2a8ad898 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:12.098679 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:12.190231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af0c0-a858-4e90-99f2-69e90ce65614 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.225972 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 128/253] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:12.226159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.226738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.227058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.227426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.228521 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.228718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:12.229191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.229678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.230184 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:12.231969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 126/254] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:12.232727 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.250196 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:12.251784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:12.331552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 129/255] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:12.332734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.357254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:12.366328 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544106-aeba-458d-9c45-f76edb53fafb None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.380496 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:12.412955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.413653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.413930 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.414198 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.426182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:12.431488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:12.432462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:12.433273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 127/256] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:12.433948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.448192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6045e-1b75-46b4-a76d-fe52f50aafb4 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.487307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.488324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.488800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.489266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.490608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:12.492293 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:12.494481 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 130/257] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:12.495473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.546178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840bfe6-dfab-4228-8016-12fe21ac1ea9 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.583430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:12.583920 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.584958 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.585245 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.585518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.586468 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] RBAC: Adding query filter params (role.id=2e79002ba27647eb8ccda5f9f6ab43bc, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=d42826e41c65470b878b45e5652f07cc) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:12.586780 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:12.588542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:12.601779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196d98c-03fe-4600-a85a-e38480aa354f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.604053 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 128/258] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/role_assignments?user.id=d42826e41c65470b878b45e5652f07cc&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=2e79002ba27647eb8ccda5f9f6ab43bc => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:12.605693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.641481 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.642526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.643038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.643507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.647944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:12.656436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:12.662336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:12.663455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:12.664333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:12.667248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 131/259] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:12.668232 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.807002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328708-bc61-46a9-a3eb-656da9e85f34 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.823974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd487888-8eed-4194-8d5a-c898f12541d1 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:12.881708 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.882261 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.882540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.882813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.883562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:12.883861 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:12.885800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:12.902231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 129/260] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:12.903119 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.903951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:12.904586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:12.904866 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:12.905136 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:12.905933 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] RBAC: Adding query filter params (role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=525d30e38e47469bb36a051ed8e06a2e) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:12.906240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:12.908562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:12.917214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 132/261] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/role_assignments?user.id=525d30e38e47469bb36a051ed8e06a2e&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:12.919145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:12.948544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:13.111824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:13.124894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709a782-553c-4140-8958-9bb3f4636d62 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:13.143171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69bca0-91c5-47f5-b185-5df25333e9f9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:13.160050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:13.160682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:13.160967 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:13.161247 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:13.161961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:13.162271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:13.163773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:13.172688 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 130/262] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:13.178113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:13.214461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:13.215180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:13.215463 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:13.215738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] PATH_INFO: `/v3/users/525d30e38e47469bb36a051ed8e06a2e` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:13.220504 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] RBAC: Authorizing `identity:get_user(user_id=525d30e38e47469bb36a051ed8e06a2e)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:13.223311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:13.226324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 133/263] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:12 2022] GET /identity/v3/users/525d30e38e47469bb36a051ed8e06a2e => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:13.237765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:13.399793 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2bcc-4d88-4924-8688-6d8518caa20e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:13.409214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:13.434663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:13.435355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:13.435636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:13.435911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] PATH_INFO: `/v3/users/1896355e81f5433b8ff161e1c66513b2` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:13.437197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] RBAC: Authorizing `identity:get_user(user_id=1896355e81f5433b8ff161e1c66513b2)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:13.438655 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:13.440397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 131/264] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:13 2022] GET /identity/v3/users/1896355e81f5433b8ff161e1c66513b2 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:13.450964 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:13.465171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e80b-f1a3-4eb3-aedb-677f6313d13d None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:13.491669 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:13.531092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:13.532243 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:13.534122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:13.534649 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:13.647324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:13.649601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:13.649890 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd788397-8c47-407a-b240-c4bd860db72a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:13.722054 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:13.723118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:13.723602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:13.724074 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:13.727567 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:13.729800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:13.733174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 132/265] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:13 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:13.738832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:13.779417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:13.814824 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 134/266] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:13.824781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:13.927566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:13.961092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9aee-9dc0-4cc3-83e2-83d42abfe134 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:13.964596 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0a61c-8b72-4ad6-9ffd-95ca563757b5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.001737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.002398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.002674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.002967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.004222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.005711 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.007810 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:13 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:14.015880 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.040711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199fc7f-512d-4a09-bcc0-dd763fc537b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.041477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199fc7f-512d-4a09-bcc0-dd763fc537b4 None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.041756 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199fc7f-512d-4a09-bcc0-dd763fc537b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.042032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199fc7f-512d-4a09-bcc0-dd763fc537b4 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd/users/1896355e81f5433b8ff161e1c66513b2/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.044898 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199fc7f-512d-4a09-bcc0-dd763fc537b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=161f42e62554415799e108f3a19fcecd, user_id=1896355e81f5433b8ff161e1c66513b2, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.046364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199fc7f-512d-4a09-bcc0-dd763fc537b4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.072003 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 133/268] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:13 2022] PUT /identity/v3/projects/161f42e62554415799e108f3a19fcecd/users/1896355e81f5433b8ff161e1c66513b2/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:14.096531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:14.169794 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c8db-bbdf-4527-a3d0-fec67e0a285c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.201002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4db5d-6c6d-4c0b-82e5-3147552322be None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.201352 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4db5d-6c6d-4c0b-82e5-3147552322be None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.201556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4db5d-6c6d-4c0b-82e5-3147552322be None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.203207 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 134/269] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:14.208900 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c440a6b-7cc8-46bb-a771-51dce1dd4a27 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.209229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c440a6b-7cc8-46bb-a771-51dce1dd4a27 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.209448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c440a6b-7cc8-46bb-a771-51dce1dd4a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.238355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-8c440a6b-7cc8-46bb-a771-51dce1dd4a27 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:14.240371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.241007 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.241283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.241555 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.242398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=525d30e38e47469bb36a051ed8e06a2e) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:14.242705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.244271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d997c7-542e-40a5-a18c-6ae30382fb0d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.247158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-8c440a6b-7cc8-46bb-a771-51dce1dd4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:14.258646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 136/270] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:14 2022] GET /identity/v3/role_assignments?user.id=525d30e38e47469bb36a051ed8e06a2e&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=068868605675478a8abe0ef53a447f78 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:14.340703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 135/271] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:14.358993 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128dd63-40a4-46cb-bcb3-44e8c0533e74 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.359485 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128dd63-40a4-46cb-bcb3-44e8c0533e74 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.359969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128dd63-40a4-46cb-bcb3-44e8c0533e74 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.364028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 137/272] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:14.368963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.369867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.370085 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.384211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128dd63-40a4-46cb-bcb3-44e8c0533e74 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.401486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:14.402997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:14.505548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 136/273] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:14.528588 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128dd63-40a4-46cb-bcb3-44e8c0533e74 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.537148 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.538948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:14.546356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:14.568304 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.569226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.569698 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.570139 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.571645 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.573413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.575530 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 138/274] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:14.582048 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.649371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0ee68-a118-4398-b1ba-a8c172028510 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.685782 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.686417 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.686689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.686980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.697988 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:14.698491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ebe81-0bcd-4447-ae2b-dc852c1e0ff2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:14.703453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:14.704556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:14.705538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:14.710367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.740017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.741009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.741514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.741968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.742956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.744739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.771093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 139/276] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:14 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:14.798733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:14.839700 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528b4e5-134e-40b0-95ba-dd06e76e9eae None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:14.881493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:14.882404 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:14.882846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:14.883246 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:14.884035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:14.884345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:14.885835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:14.895816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:14.901374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:14.938830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:15.017315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22652f-06f0-4ea0-84e7-c2ca18249924 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:15.053328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9760-5828-434a-900e-a0d93d353189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:15.053980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9760-5828-434a-900e-a0d93d353189 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:15.054330 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9760-5828-434a-900e-a0d93d353189 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:15.054586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9760-5828-434a-900e-a0d93d353189 None admin] PATH_INFO: `/v3/users/6ab40a0f863b4198981db0306f23cb77` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:15.068942 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9760-5828-434a-900e-a0d93d353189 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab40a0f863b4198981db0306f23cb77)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:15.070408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9760-5828-434a-900e-a0d93d353189 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:15.072456 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 140/278] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:14 2022] GET /identity/v3/users/6ab40a0f863b4198981db0306f23cb77 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:15.078099 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:15.194009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35b06f-e768-4163-b132-a0aed4a4d0da None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:15.224916 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:15.235596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:15.236221 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:15.236499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:15.236769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:15.237551 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, user.id=6ab40a0f863b4198981db0306f23cb77, scope.system=all) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:15.237859 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:15.239394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de65e26-2365-42d0-b66d-3383609cc626 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:15.245455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 139/279] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 21:43:15 2022] GET /identity/v3/role_assignments?user.id=6ab40a0f863b4198981db0306f23cb77&scope.system=all&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:15.633050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717959-cea2-41a0-8ff9-a1e590b904a5 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:15.633420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717959-cea2-41a0-8ff9-a1e590b904a5 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:15.633622 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717959-cea2-41a0-8ff9-a1e590b904a5 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:15.635265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 141/280] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:15.640591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:15.640880 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:15.641158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:15.663882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:15.665092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:15.746240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 140/281] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:15.789502 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717959-cea2-41a0-8ff9-a1e590b904a5 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:15.892038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:15.911757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717959-cea2-41a0-8ff9-a1e590b904a5 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:15.972605 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:15.973651 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:15.974131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:15.974599 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:15.995019 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:16.000242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:16.001109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:16.001934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:16.004512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 142/282] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:16.010464 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:16.186538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7373f-372a-4a0d-bd10-2a908026a287 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:16.217480 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:16.235569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:16.236200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:16.236479 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:16.236749 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:16.237465 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:16.237772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:16.239173 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:16.248495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 141/283] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:16.253866 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:16.404242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c5b87-7d30-4fa6-9707-85aaee56e8a7 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:16.448532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:16.449182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:16.449464 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:16.449740 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] PATH_INFO: `/v3/users/d42826e41c65470b878b45e5652f07cc` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:16.450901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] RBAC: Authorizing `identity:get_user(user_id=d42826e41c65470b878b45e5652f07cc)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:16.452365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:16.454314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:16 2022] GET /identity/v3/users/d42826e41c65470b878b45e5652f07cc => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:16.459753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:16.617809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d038855-9b9a-41aa-9c19-46d5a136bd8a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:16.662638 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc82e2-6c36-484c-a022-fb3f345cc7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:16.663702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc82e2-6c36-484c-a022-fb3f345cc7ff None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:16.664178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc82e2-6c36-484c-a022-fb3f345cc7ff None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:16.664641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc82e2-6c36-484c-a022-fb3f345cc7ff None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:16.671844 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc82e2-6c36-484c-a022-fb3f345cc7ff None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:16.673641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc82e2-6c36-484c-a022-fb3f345cc7ff None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:16.675635 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 142/285] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:16 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:16.683977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:16.719995 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:16.839140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b583314-f9d9-404a-b7b7-7cfaa3e48f2d None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:16.879169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15e044-f94f-48f4-af89-70cb749e1f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:16.879767 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15e044-f94f-48f4-af89-70cb749e1f68 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:16.880047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15e044-f94f-48f4-af89-70cb749e1f68 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:16.880327 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15e044-f94f-48f4-af89-70cb749e1f68 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd/users/d42826e41c65470b878b45e5652f07cc/roles/2e79002ba27647eb8ccda5f9f6ab43bc` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:16.882282 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15e044-f94f-48f4-af89-70cb749e1f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=161f42e62554415799e108f3a19fcecd, user_id=d42826e41c65470b878b45e5652f07cc, role_id=2e79002ba27647eb8ccda5f9f6ab43bc)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:16.883756 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15e044-f94f-48f4-af89-70cb749e1f68 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:16.920888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 144/286] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:16 2022] PUT /identity/v3/projects/161f42e62554415799e108f3a19fcecd/users/d42826e41c65470b878b45e5652f07cc/roles/2e79002ba27647eb8ccda5f9f6ab43bc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:17.004462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d121bd-ba37-4fa1-999c-ff09a36283e1 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.004462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d121bd-ba37-4fa1-999c-ff09a36283e1 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.004462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d121bd-ba37-4fa1-999c-ff09a36283e1 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.004462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 143/287] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:17.014255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.014821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.015268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.040325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.041880 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.144052 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 145/288] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:17.173302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d121bd-ba37-4fa1-999c-ff09a36283e1 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.233167 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.302783 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d121bd-ba37-4fa1-999c-ff09a36283e1 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.347752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.348398 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.348671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.348940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.367807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:17.373728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:17.374629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:17.375514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 144/289] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:17.381208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.397821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.542333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2d0b5-a96f-4ddc-9737-a211fe8343be None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.597991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.598615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.598888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.599178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.599893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:17.600191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.601638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d221601-8d29-418f-9382-f792c6b2dd5c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.614343 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 146/290] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:17.620242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.757147 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8c76-a628-4dfd-a43c-270974bbc1d1 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.761763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a292-cd55-4dad-a2ed-85b2e1266467 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.762331 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a292-cd55-4dad-a2ed-85b2e1266467 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.762805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8a292-cd55-4dad-a2ed-85b2e1266467 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.764402 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 147/291] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:17.772151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925f36-1642-42bd-af76-b7b6deb54054 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.772680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925f36-1642-42bd-af76-b7b6deb54054 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.773179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925f36-1642-42bd-af76-b7b6deb54054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.779761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.795053 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.795741 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.796022 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.796295 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] PATH_INFO: `/v3/users/1896355e81f5433b8ff161e1c66513b2` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.802963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1896355e81f5433b8ff161e1c66513b2)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.802963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.802963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 145/292] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/users/1896355e81f5433b8ff161e1c66513b2 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:17.806739 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.816121 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-57925f36-1642-42bd-af76-b7b6deb54054 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.817701 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-57925f36-1642-42bd-af76-b7b6deb54054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.913979 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbb8aa-b0d6-4f92-9bdc-5bb942baa4c4 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.954948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.954948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.954948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.954948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.977138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.995266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 148/293] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:17.996723 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875aba-b7f2-4851-a1fb-9d7ca1a8c9bb None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.997014 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875aba-b7f2-4851-a1fb-9d7ca1a8c9bb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.997287 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875aba-b7f2-4851-a1fb-9d7ca1a8c9bb None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.998823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 149/294] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:18.007471 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.018839 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.019147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.019420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.027849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:18.029322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:18.039586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:18.041493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:18.132240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 150/295] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:18.132240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.153631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 146/296] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:43:18.159348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.246809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.259216 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2beb15-6e4d-4f3d-ba81-6db0c362729f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.267759 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05aaa-8a50-4b7e-91d4-5053fc7d81d5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.293312 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.299857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.300511 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.300790 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.301067 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.302142 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585024c-4937-4c95-858c-fdc8048ec386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.302269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:18.302783 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585024c-4937-4c95-858c-fdc8048ec386 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.303087 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585024c-4937-4c95-858c-fdc8048ec386 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.303354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585024c-4937-4c95-858c-fdc8048ec386 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.304480 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585024c-4937-4c95-858c-fdc8048ec386 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:18.304664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:18.306019 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585024c-4937-4c95-858c-fdc8048ec386 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:18.315084 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 151/297] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:18.315084 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.315316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 147/298] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:18.315316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5562f-bd67-4d52-a315-15e0b3e8b27c None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.315316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5562f-bd67-4d52-a315-15e0b3e8b27c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.315316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5562f-bd67-4d52-a315-15e0b3e8b27c None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.315316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 148/299] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:18.316610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5562f-bd67-4d52-a315-15e0b3e8b27c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.449779 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5562f-bd67-4d52-a315-15e0b3e8b27c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.450077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3efdd-ace7-4191-9805-fddc20282a50 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.491446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe161a85-f1f6-4a95-8c58-8d667cb64da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.492081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe161a85-f1f6-4a95-8c58-8d667cb64da8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.492356 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe161a85-f1f6-4a95-8c58-8d667cb64da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.492476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.492650 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe161a85-f1f6-4a95-8c58-8d667cb64da8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.493007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.493283 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.493554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] PATH_INFO: `/v3/groups` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.494732 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:18.496668 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:18.503458 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe161a85-f1f6-4a95-8c58-8d667cb64da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-fe161a85-f1f6-4a95-8c58-8d667cb64da8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:18.508518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:18.509710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:18.511096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 152/300] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:18.511782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.511782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.511782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.531914 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 149/301] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Jul 25 21:43:18 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:18.531914 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.537764 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:18.538995 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:18.544339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.601663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.623363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 153/302] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:18.624347 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.665579 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979f10-2f02-49be-a11b-44887d7d954e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.704629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.705382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.705669 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.705947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.706753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=1896355e81f5433b8ff161e1c66513b2) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:18.707115 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:18.708862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:18.716032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 150/303] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/role_assignments?user.id=1896355e81f5433b8ff161e1c66513b2&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:18.716998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.751912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429efc7b-4275-42a1-a175-a347a641da27 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.788848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.789408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.789684 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.789952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.790687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:18.791722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:18.793309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:18.804952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 154/304] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:18.811434 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.813428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.845386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc0c59-5e06-45bf-a5e4-b689996bb4f6 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.873800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:18.889820 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.890882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.891500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.891974 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:18.904643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:18.911023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:18.911934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:18.912849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:18.915506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 151/305] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:18.921693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:18.947407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28aa6-fcd8-4657-93d9-3498d2831211 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:18.995126 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:18.995126 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:18.995837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:18.995837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] PATH_INFO: `/v3/users/9a967304aeaf499cb851fca78a128685` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.015807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] RBAC: Authorizing `identity:get_user(user_id=9a967304aeaf499cb851fca78a128685)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:19.017594 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:19.020698 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 155/306] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/users/9a967304aeaf499cb851fca78a128685 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:19.026844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:19.053372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec92-36c4-4510-a6cf-590525d31c0f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:19.087614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:19.094903 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:19.096889 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.097781 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.098445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.099604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:19.100111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:19.102172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:19.112915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 152/307] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:19.123657 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:19.168363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51df4a1-a8df-4d91-8321-3d304758f59b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:19.178656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:19.206994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:19.207798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.208148 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.208574 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.209429 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] RBAC: Adding query filter params (role.id=2e79002ba27647eb8ccda5f9f6ab43bc, user.id=9a967304aeaf499cb851fca78a128685, scope.system=all) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:19.209808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:19.211383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:19.223185 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 156/308] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 21:43:19 2022] GET /identity/v3/role_assignments?user.id=9a967304aeaf499cb851fca78a128685&scope.system=all&role.id=2e79002ba27647eb8ccda5f9f6ab43bc => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:19.240819 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b89612-bb35-49d2-8aa6-17c79a3def44 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:19.280273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9d6d2-40ca-4b68-91d3-432a9673ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:19.280950 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9d6d2-40ca-4b68-91d3-432a9673ad00 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.281233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9d6d2-40ca-4b68-91d3-432a9673ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.281509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9d6d2-40ca-4b68-91d3-432a9673ad00 None admin] PATH_INFO: `/v3/users/6ab40a0f863b4198981db0306f23cb77` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.282801 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9d6d2-40ca-4b68-91d3-432a9673ad00 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab40a0f863b4198981db0306f23cb77)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:19.284594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9d6d2-40ca-4b68-91d3-432a9673ad00 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:19.286662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 153/309] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:19 2022] GET /identity/v3/users/6ab40a0f863b4198981db0306f23cb77 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:19.292691 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:19.407280 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcad0d-6677-487f-8882-df0a3e09d526 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:19.444724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed57d-160a-4a13-bdce-78fb654f6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:19.445398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed57d-160a-4a13-bdce-78fb654f6a0e None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.445676 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed57d-160a-4a13-bdce-78fb654f6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.445952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed57d-160a-4a13-bdce-78fb654f6a0e None admin] PATH_INFO: `/v3/system/users/6ab40a0f863b4198981db0306f23cb77/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.447982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed57d-160a-4a13-bdce-78fb654f6a0e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ab40a0f863b4198981db0306f23cb77, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:19.449373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed57d-160a-4a13-bdce-78fb654f6a0e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:19.464351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 157/310] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Jul 25 21:43:19 2022] PUT /identity/v3/system/users/6ab40a0f863b4198981db0306f23cb77/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:19.569671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caa87a-1d63-42d5-8df0-9160b7c44c3c None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.570326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caa87a-1d63-42d5-8df0-9160b7c44c3c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.570798 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06caa87a-1d63-42d5-8df0-9160b7c44c3c None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.572788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 154/311] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:19.578745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.579411 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.579891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.600185 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:19.601793 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:19.636482 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:19.689260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 158/312] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:19.713687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caa87a-1d63-42d5-8df0-9160b7c44c3c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:19.779002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:19.821496 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06caa87a-1d63-42d5-8df0-9160b7c44c3c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:19.857832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:19.858532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:19.858814 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:19.859116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:19.872161 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:19.877539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:19.878433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:19.879810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 155/313] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:19.884706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:20.002811 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b86d5-6f5a-4cd8-997a-26d7bf176444 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:20.041221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:20.041841 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:20.042117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:20.042389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:20.043136 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:20.043441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:20.044811 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:20.053996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 159/314] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:20.060074 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:20.165539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efef571-a0f4-4031-b8f5-b028496a8500 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:20.189239 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:20.203104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:20.204077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:20.204529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:20.205007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] PATH_INFO: `/v3/users/d42826e41c65470b878b45e5652f07cc` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:20.206333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] RBAC: Authorizing `identity:get_user(user_id=d42826e41c65470b878b45e5652f07cc)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:20.207970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:20.210040 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 156/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:20 2022] GET /identity/v3/users/d42826e41c65470b878b45e5652f07cc => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:20.216406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:20.246880 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:20.323825 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8cf8-7bb3-4705-82df-c7cebed8aab0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:20.358704 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:20.359665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:20.360219 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:20.360695 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:20.430834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:20.432979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:20.466312 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:20.543537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:20.549089 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:20.659963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45939ec-c58c-4036-a54a-342db52cfe4c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:20.695049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49866dbf-05b7-4804-a703-023468537de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:20.695696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866dbf-05b7-4804-a703-023468537de4 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:20.695978 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866dbf-05b7-4804-a703-023468537de4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:20.696254 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49866dbf-05b7-4804-a703-023468537de4 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:20.697572 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866dbf-05b7-4804-a703-023468537de4 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:20.699046 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49866dbf-05b7-4804-a703-023468537de4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:20.700733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 157/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:20 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:20.706789 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:20.815212 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e243-fd81-400a-89ec-c16aa184197f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:20.843476 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:20.851905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:20.852524 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:20.854536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:20.855022 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:20.855986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] RBAC: Adding query filter params (role.id=2e79002ba27647eb8ccda5f9f6ab43bc, scope.project.id=161f42e62554415799e108f3a19fcecd, user.id=d42826e41c65470b878b45e5652f07cc) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:20.856302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:20.857730 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b278e3-1a84-4f76-8cb9-ab6ad9e3dd37 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:20.864116 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 161/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:20 2022] GET /identity/v3/role_assignments?user.id=d42826e41c65470b878b45e5652f07cc&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=2e79002ba27647eb8ccda5f9f6ab43bc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:21.193939 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136c485-5ba7-4bfe-98bd-3247fdfb242b None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.194462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136c485-5ba7-4bfe-98bd-3247fdfb242b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.194462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136c485-5ba7-4bfe-98bd-3247fdfb242b None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.196183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 158/319] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:21.201161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.201549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.201706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.220630 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:21.221815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:21.290715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 162/320] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:21.314789 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136c485-5ba7-4bfe-98bd-3247fdfb242b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:21.385322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:21.430348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136c485-5ba7-4bfe-98bd-3247fdfb242b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:21.471542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547131-ab3d-4eba-a7c4-b1e383edda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:21.472110 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547131-ab3d-4eba-a7c4-b1e383edda66 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.472437 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547131-ab3d-4eba-a7c4-b1e383edda66 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.472708 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547131-ab3d-4eba-a7c4-b1e383edda66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.473901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547131-ab3d-4eba-a7c4-b1e383edda66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:21.475360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547131-ab3d-4eba-a7c4-b1e383edda66 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:21.481342 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 159/321] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:21.482535 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:21.578562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b955-949f-4f29-b804-de6947476dfd None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.578851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b955-949f-4f29-b804-de6947476dfd None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.579172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b955-949f-4f29-b804-de6947476dfd None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.580757 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 160/322] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:21.584710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983389b-4d1a-43e5-aa80-32b8a98e022a None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:21.587059 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409adedb-2971-419a-994d-c69e2189c559 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.588367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409adedb-2971-419a-994d-c69e2189c559 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.588367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409adedb-2971-419a-994d-c69e2189c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.609993 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-409adedb-2971-419a-994d-c69e2189c559 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:21.617750 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-409adedb-2971-419a-994d-c69e2189c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:21.623115 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:21.642373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:21.643034 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.643314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.643583 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] PATH_INFO: `/v3/groups` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.644246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:21.645687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:21.671017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 163/323] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Jul 25 21:43:21 2022] POST /identity/v3/groups => generated 226 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:21.701720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 161/324] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:21.725212 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:21.740481 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafa1c-a8c7-4954-ad5c-d888cac88fb1 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.740835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafa1c-a8c7-4954-ad5c-d888cac88fb1 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.741136 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafa1c-a8c7-4954-ad5c-d888cac88fb1 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.742734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 162/325] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:21.748462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.748740 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.749014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.768275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:21.769306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:21.826863 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:21.844671 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654784e-3e0f-4fb1-ae28-7b8f5310d786 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:21.850260 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 163/326] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:21.876869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:21.885068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:21.886968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:21.886968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:21.886968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:21.899720 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:21.905945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:21.906860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:21.907737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:21.914107 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:21.971656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:22.002518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108490c-7d71-4975-acf2-02d16ae96659 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.047019 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45428-0d66-4a83-9357-fab9e85a44d6 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.058339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.060671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.060671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.060671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.074726 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:22.080235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:22.081155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:22.082006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 164/328] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:22.087978 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:22.092214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.092852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.093133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.093414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.094145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:22.094451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:22.095874 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:22.111109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:22.116511 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:22.140549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:22.217289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dfcec-3d39-4220-a10a-69d87a1ee267 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.247862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0228c2-1f5b-42d9-9086-cfdd79cc57bd None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.250884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:22.257752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.258645 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.259164 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.260200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.261122 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:22.261624 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:22.263337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:22.273253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 165/330] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:22.279389 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:22.295159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.295813 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.296088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.296347 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] PATH_INFO: `/v3/users/9a967304aeaf499cb851fca78a128685` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.297939 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] RBAC: Authorizing `identity:get_user(user_id=9a967304aeaf499cb851fca78a128685)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:22.299715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:22.302990 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:22 2022] GET /identity/v3/users/9a967304aeaf499cb851fca78a128685 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:22.308579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:22.424189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b011-13b7-43b4-8bb8-5613425c24eb None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.430849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cff87-b86f-4a51-b462-74e9a4471302 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.444301 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:22.477456 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.477456 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.477456 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.477692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] PATH_INFO: `/v3/users/6ab40a0f863b4198981db0306f23cb77` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.479599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] RBAC: Authorizing `identity:get_user(user_id=6ab40a0f863b4198981db0306f23cb77)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:22.481882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:22.483230 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:22 2022] GET /identity/v3/users/6ab40a0f863b4198981db0306f23cb77 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:22.490266 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:22.493758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121c23-6b3c-4190-bf7f-b70360f72b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.495607 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121c23-6b3c-4190-bf7f-b70360f72b44 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.495607 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121c23-6b3c-4190-bf7f-b70360f72b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.495607 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121c23-6b3c-4190-bf7f-b70360f72b44 None admin] PATH_INFO: `/v3/system/users/9a967304aeaf499cb851fca78a128685/roles/2e79002ba27647eb8ccda5f9f6ab43bc` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.496562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121c23-6b3c-4190-bf7f-b70360f72b44 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a967304aeaf499cb851fca78a128685, role_id=2e79002ba27647eb8ccda5f9f6ab43bc)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:22.497953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121c23-6b3c-4190-bf7f-b70360f72b44 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:22.512549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 167/333] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Jul 25 21:43:22 2022] PUT /identity/v3/system/users/9a967304aeaf499cb851fca78a128685/roles/2e79002ba27647eb8ccda5f9f6ab43bc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:22.618424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce4b2f-9a89-4082-a8ed-fafc3d86dc13 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:22.657070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:22.658079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:22.658811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:22.659323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:22.660329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] RBAC: Adding query filter params (role.id=abb02adff3a84d22a1b1b382e4c95e68, user.id=6ab40a0f863b4198981db0306f23cb77, scope.system=all) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:22.660835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:22.662591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c965a4-833a-47e5-b3b1-11301cd5c3c5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:22.677756 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 21:43:22 2022] GET /identity/v3/role_assignments?user.id=6ab40a0f863b4198981db0306f23cb77&scope.system=all&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:24.344537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516ee5-2286-435a-9119-205462a1b84d None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:24.345177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516ee5-2286-435a-9119-205462a1b84d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:24.345177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516ee5-2286-435a-9119-205462a1b84d None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:24.346782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 168/335] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:24.352769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:24.354303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:24.354809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:24.384272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:24.385883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:24.421998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:24.477294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 168/336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:24.516151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516ee5-2286-435a-9119-205462a1b84d None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:24.572169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:24.655105 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516ee5-2286-435a-9119-205462a1b84d None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:24.696891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:24.697585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:24.697862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:24.698138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:24.721338 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:24.726220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:24.727188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:24.728023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:24.729284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 169/337] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:24.735842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:24.893613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73648716-b1b1-43d8-a11c-d2d58aa5084c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:24.940562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:24.941439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:24.941872 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:24.942297 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:24.943194 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:24.943663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:24.945188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c206-7a23-44ef-ba19-69dfdbd21304 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:24.958978 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 169/338] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:24.962544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.105513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.112994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e3c4a-1e6b-4d0f-a93e-6dc3bc697ca7 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.154431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fc03e-c4ab-4bb0-a6c8-d32f5116fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.155082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fc03e-c4ab-4bb0-a6c8-d32f5116fdcd None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.155358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fc03e-c4ab-4bb0-a6c8-d32f5116fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.155649 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fc03e-c4ab-4bb0-a6c8-d32f5116fdcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.248635 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fc03e-c4ab-4bb0-a6c8-d32f5116fdcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.250032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fc03e-c4ab-4bb0-a6c8-d32f5116fdcd None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.313223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec556df-b607-4863-82e7-a51ffb4c3ac5 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.313866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec556df-b607-4863-82e7-a51ffb4c3ac5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.314830 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec556df-b607-4863-82e7-a51ffb4c3ac5 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.317103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 170/339] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:25.319178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d1b3-5d28-455c-9b34-a177531fff15 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.319743 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d1b3-5d28-455c-9b34-a177531fff15 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.320350 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d1b3-5d28-455c-9b34-a177531fff15 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.324709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 171/340] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:25.326695 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.327228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.327714 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.368318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.369133 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:25.370597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:25.371075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 170/341] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:25.372400 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.372680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.373009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.402695 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:25.406071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:25.422166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.477061 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 171/342] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:25.477903 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.515631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 172/343] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:25.545342 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.582662 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558dc62-16b0-4a86-b0b9-e35908919a5d None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.612009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.628021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.628964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.629394 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.629817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.631198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.632872 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.636072 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 172/344] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:25 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:25.637230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.736159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5a31f-2a74-4fb8-b991-67604f7f9e5c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.766246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67675b07-b856-4e39-856c-bbae16d8e21e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.795851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.796675 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.797061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.797467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.813957 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.814624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.814906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.815208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.816505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:25.826702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:25.827683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:25.828487 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 173/345] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:25.829166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.840452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:25.846848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:25.847854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:25.848763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:25.851319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 173/346] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:25.852912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.881211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.935882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.994808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d488a12-185f-4021-bdb2-3cfc9efc058c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.077514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe594b-6203-4512-94c3-5182b0b0bcd7 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.080461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.081366 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.081881 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.082373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.083376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:26.083899 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.086270 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.102872 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 174/347] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:26.105969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.153889 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.154546 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.154818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.155151 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.161986 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.163550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.165586 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 174/348] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:25 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:26.166395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.238737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11851bf5-ec9a-4420-90f4-87a2adfc6464 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.254042 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.256406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.273936 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5cbe8-e8f1-4498-bad6-6b30171bd86b None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.275693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.276322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.276601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.276877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.277597 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:26.277898 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.280334 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c717bf-69d6-4409-935f-52488d30f84a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.289517 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 175/349] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:26.291280 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3763ea1-9e66-4015-8d25-ca09d18ded37 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.295365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3763ea1-9e66-4015-8d25-ca09d18ded37 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.295649 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3763ea1-9e66-4015-8d25-ca09d18ded37 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.297235 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 176/350] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:26.297969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3763ea1-9e66-4015-8d25-ca09d18ded37 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.315699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf332-ca95-4dc3-b3a7-6efb601c01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.316331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf332-ca95-4dc3-b3a7-6efb601c01ce None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.316662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf332-ca95-4dc3-b3a7-6efb601c01ce None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.316937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf332-ca95-4dc3-b3a7-6efb601c01ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.414778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf332-ca95-4dc3-b3a7-6efb601c01ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.416240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf332-ca95-4dc3-b3a7-6efb601c01ce None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.443556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3763ea1-9e66-4015-8d25-ca09d18ded37 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.495355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.496437 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.496709 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.496986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.497784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:26.498095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.500750 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.508486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 177/351] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:26.509338 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.519296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.533898 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 175/352] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:26.537665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce373f-d1c0-4599-b775-5b9e11a67b61 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.537955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce373f-d1c0-4599-b775-5b9e11a67b61 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.538244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce373f-d1c0-4599-b775-5b9e11a67b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.560836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c8ce373f-d1c0-4599-b775-5b9e11a67b61 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:26.562048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c8ce373f-d1c0-4599-b775-5b9e11a67b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:26.566765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.638370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca3579-5e9f-467e-89e1-4e2319b1a6e1 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.644622 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 176/353] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:26.652515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812de9-43c4-436f-9a81-4e915f75003c None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.652800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812de9-43c4-436f-9a81-4e915f75003c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.653077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812de9-43c4-436f-9a81-4e915f75003c None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.654570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 177/354] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:26.655408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812de9-43c4-436f-9a81-4e915f75003c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.683239 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.683909 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.684311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.684656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.766973 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.769019 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.806219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812de9-43c4-436f-9a81-4e915f75003c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.819590 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.830894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.856355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d19039-c196-4778-8fc4-cc89767985a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.857367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19039-c196-4778-8fc4-cc89767985a9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.857825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19039-c196-4778-8fc4-cc89767985a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.858315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19039-c196-4778-8fc4-cc89767985a9 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.860677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19039-c196-4778-8fc4-cc89767985a9 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.862348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19039-c196-4778-8fc4-cc89767985a9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.864428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 178/355] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:26.865845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.866314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.866894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.888568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:26.889766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:26.904633 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 178/356] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:26.905791 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.973171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 179/357] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:26.974205 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.028822 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fce12-45c3-47c0-a421-1bda3db44443 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.066769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.067446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.067722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.067992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.079980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:27.085013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:27.085916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:27.086724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 179/358] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:27.087421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.105515 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.114268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f701187-176a-4db1-a5be-5ea87f0a9c42 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.124856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.153041 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.153706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.153986 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.154264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.155458 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.156910 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.158771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 180/359] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.159567 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.221734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813039-65b9-40c2-b290-78de267b5d04 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.266165 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.266736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.267068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.267343 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.268507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.269966 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.271984 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 180/360] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.272762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.287932 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fef33-93a3-479a-95df-e0336c8e4b55 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.335221 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206bc31-8f5d-413c-bade-2c0efd60730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.335989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206bc31-8f5d-413c-bade-2c0efd60730d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.336271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206bc31-8f5d-413c-bade-2c0efd60730d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.336636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206bc31-8f5d-413c-bade-2c0efd60730d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.348149 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206bc31-8f5d-413c-bade-2c0efd60730d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-b206bc31-8f5d-413c-bade-2c0efd60730d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:27.353971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:27.354970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:43:27.355825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:27.356482 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.356582 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 181/361] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:27.359977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e5297-5d08-406b-8c61-c31c69a3f271 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.359977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e5297-5d08-406b-8c61-c31c69a3f271 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.359977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e5297-5d08-406b-8c61-c31c69a3f271 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.359977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 182/362] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:27.360270 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e5297-5d08-406b-8c61-c31c69a3f271 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.394996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7f06-2f6e-4edd-a071-8ceae068d062 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.402762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.439124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.439425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.439803 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.440174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.441002 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:27.441424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.443015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.453040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 181/363] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.453807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.500298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e5297-5d08-406b-8c61-c31c69a3f271 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.547288 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.548266 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.548556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.548834 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.549625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=161f42e62554415799e108f3a19fcecd) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:27.549933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.551828 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.559699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 183/364] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.560354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.586192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c01c9d-4bb4-4cd5-9fdc-6f211f629e1a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.637779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179629-676e-4b62-b6ff-c4eb854ebd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.639058 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179629-676e-4b62-b6ff-c4eb854ebd5a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.639354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179629-676e-4b62-b6ff-c4eb854ebd5a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.639912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179629-676e-4b62-b6ff-c4eb854ebd5a None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.641558 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da179629-676e-4b62-b6ff-c4eb854ebd5a None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.643877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da179629-676e-4b62-b6ff-c4eb854ebd5a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.646895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 182/365] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.648286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.648573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.649123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.665485 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.674644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:27.676191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:27.692655 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.696196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68853a09-3315-4ff6-9044-d482ac1ae7ea None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.742064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.742793 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.743158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.743433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.744772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:27.745080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.746737 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.759367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 184/366] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.760453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.770595 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 183/367] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:27.771500 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:27.909427 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71681ea5-e7a9-4083-9932-6f8e65736255 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.910135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77900d-9bdd-4e3a-9a93-d069e8d38895 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:27.950280 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:27.959830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.960456 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.960741 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.961082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.961882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:27.962200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:27.963933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:27.964213 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:27.965001 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:27.965484 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:27.966212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:27.971172 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 184/368] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:27.971601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.016537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.076964 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.079227 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.107231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed5fc2-67bf-42c5-b629-2f7592097466 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.159002 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.159363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.159643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.159873 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] PATH_INFO: `/v3/users/9a967304aeaf499cb851fca78a128685` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.161083 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] RBAC: Authorizing `identity:get_user(user_id=9a967304aeaf499cb851fca78a128685)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.162575 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.164313 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 185/369] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/users/9a967304aeaf499cb851fca78a128685 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:28.165102 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.221696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 185/370] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:28.227206 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.241924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.290031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277c877-9179-418c-b780-9de0f671e62a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.301455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.333207 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.333865 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.334145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.334419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.348046 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:28.355424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:28.356306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:28.357145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:28.357762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f8b5-cfa8-4ecf-a24b-25b72f5376d0 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.357834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 186/371] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:28.357834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.402700 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.403368 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.403650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.403928 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.404719 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] RBAC: Adding query filter params (role.id=2e79002ba27647eb8ccda5f9f6ab43bc, user.id=9a967304aeaf499cb851fca78a128685, scope.system=all) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:28.405028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.406586 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.420893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 186/372] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/role_assignments?user.id=9a967304aeaf499cb851fca78a128685&scope.system=all&role.id=2e79002ba27647eb8ccda5f9f6ab43bc => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:28.421664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.507113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6666133-32b2-4322-9d4a-7b24a26632e0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.546279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.553699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16ace1-b548-4fa6-a533-c72f513459ba None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.570586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.571323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.571664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.571879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.577624 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.579765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.581255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.583793 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 187/373] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:28.589805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.595843 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.596684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.597264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.597689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.598573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:28.599337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.600988 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.612123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 187/374] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:28.618082 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.730338 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc12d8-c912-47cd-b2e6-d35b84bfe5fd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.747717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d699c7-3f13-474a-b072-840f4b08daa1 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.772630 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.773509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.774065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.796292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:28.796955 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:28.797236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:28.797520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:28.798796 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.800356 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.802302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 188/375] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:28.808989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:28.853616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:28.856585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:28.871164 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.898947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:28.957521 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af519a-f6e4-4151-a57f-b9c35c44d91f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:28.982175 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 188/376] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:28.988082 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:29.013946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:29.014616 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.014943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.015196 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.015991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=161f42e62554415799e108f3a19fcecd) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:29.016301 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:29.017746 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:29.024403 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 189/377] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:29.088120 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:29.109380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0abc0-68e6-4bf9-a363-e93277b20ae1 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:29.150099 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:29.151669 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.152169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.152640 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] PATH_INFO: `/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.154136 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=2eb79fbfdb0c462f815d677c4fd9d2a2)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:29.155865 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:29.158180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 189/378] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:28 2022] GET /identity/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:29.164387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:29.287513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb2462-ebb6-472d-a8e9-a5e4fed1b302 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:29.318478 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:29.332374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a17469-8199-48fe-b425-9cce9f85849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:29.333353 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a17469-8199-48fe-b425-9cce9f85849a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.333636 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a17469-8199-48fe-b425-9cce9f85849a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.333912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a17469-8199-48fe-b425-9cce9f85849a None admin] PATH_INFO: `/v3/groups/166c6eae883a4d389cadb636fd3a2f57` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.340168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a17469-8199-48fe-b425-9cce9f85849a None admin] RBAC: Authorizing `identity:get_group(group_id=166c6eae883a4d389cadb636fd3a2f57)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:29.341638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a17469-8199-48fe-b425-9cce9f85849a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:29.343349 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 190/379] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:29 2022] GET /identity/v3/groups/166c6eae883a4d389cadb636fd3a2f57 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:29.349634 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:29.473755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b605c-afad-4126-813b-78b638fcb0b9 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:29.523167 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957cb36-778f-4b3c-96eb-7148b3c3a84f None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.523699 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957cb36-778f-4b3c-96eb-7148b3c3a84f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.523699 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957cb36-778f-4b3c-96eb-7148b3c3a84f None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.525797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 191/380] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:29.529088 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:29.529711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.529989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.530262 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.531083 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] RBAC: Adding query filter params (group.id=166c6eae883a4d389cadb636fd3a2f57, role.id=068868605675478a8abe0ef53a447f78, scope.project.id=2eb79fbfdb0c462f815d677c4fd9d2a2) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:29.531394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:29.532830 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:29.540394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 190/381] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:29 2022] GET /identity/v3/role_assignments?group.id=166c6eae883a4d389cadb636fd3a2f57&scope.project.id=2eb79fbfdb0c462f815d677c4fd9d2a2&role.id=068868605675478a8abe0ef53a447f78 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:29.540538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.540630 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.541431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.584152 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:29.585371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:29.689346 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 192/382] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:29.731150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:29.750628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:29.861524 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be064c-a84f-4469-adfd-6f33882243a5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:29.904451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:29.905468 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:29.905947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:29.906435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:29.919817 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:29.925495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:29.926386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:29.927237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:29.929918 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 191/383] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:29.936003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:30.049038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd41b7d-97a0-409f-9c53-67d474fe12ef None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:30.071135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:30.091729 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:30.092363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:30.092644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:30.092920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:30.093651 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:30.093976 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:30.096239 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:30.111824 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 193/384] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:30.117227 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:30.213426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:30.246572 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0e818-4346-45d8-9923-312ba6e9e4d8 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:30.282058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701adce-96ab-446a-af91-81430040a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:30.282706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701adce-96ab-446a-af91-81430040a872 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:30.283011 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701adce-96ab-446a-af91-81430040a872 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:30.283285 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701adce-96ab-446a-af91-81430040a872 None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:30.284684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701adce-96ab-446a-af91-81430040a872 None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:30.286119 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701adce-96ab-446a-af91-81430040a872 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:30.288048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 192/385] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:30 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:30.294852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:30.435038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab7aa8-54d4-450a-b3a5-32c2462fa635 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:30.489489 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f9362-1920-4465-98b6-d5c3d5d83e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:30.490147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9362-1920-4465-98b6-d5c3d5d83e1a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:30.490430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9362-1920-4465-98b6-d5c3d5d83e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:30.490763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9362-1920-4465-98b6-d5c3d5d83e1a None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:30.495630 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f9362-1920-4465-98b6-d5c3d5d83e1a None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:30.497093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f9362-1920-4465-98b6-d5c3d5d83e1a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:30.499156 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 194/386] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:30 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:30.504763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701adce-96ab-446a-af91-81430040a872 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:30.640135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701adce-96ab-446a-af91-81430040a872 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:30.688998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2b6f6-00c3-4a03-90e3-debd3dd58e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:30.689685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b6f6-00c3-4a03-90e3-debd3dd58e40 None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:30.689962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b6f6-00c3-4a03-90e3-debd3dd58e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:30.690236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b6f6-00c3-4a03-90e3-debd3dd58e40 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:30.692212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b6f6-00c3-4a03-90e3-debd3dd58e40 None admin] RBAC: Authorizing `identity:create_grant(project_id=d89c05fc0e264ac88dc1802f4a1fb473, group_id=9400ac74ae414a09945f5c5c88af6a2b, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:30.693639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b6f6-00c3-4a03-90e3-debd3dd58e40 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:30.715480 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 193/387] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 21:43:30 2022] PUT /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:30.933158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8fb23-b7f7-4a8a-8d98-b4cf11db453a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:30.933669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8fb23-b7f7-4a8a-8d98-b4cf11db453a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:30.933776 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8fb23-b7f7-4a8a-8d98-b4cf11db453a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:30.935383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 195/388] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:30.941441 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:30.941895 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:30.941982 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:30.954127 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:30.970909 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:30.972154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:31.063687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:31.088576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8fb23-b7f7-4a8a-8d98-b4cf11db453a None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:31.150852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:31.224544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8fb23-b7f7-4a8a-8d98-b4cf11db453a None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:31.270744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1202c-1265-4277-8fb2-77646d1f7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:31.271798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1202c-1265-4277-8fb2-77646d1f7c1c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.272273 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1202c-1265-4277-8fb2-77646d1f7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.272740 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1202c-1265-4277-8fb2-77646d1f7c1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.285877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1202c-1265-4277-8fb2-77646d1f7c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-74d1202c-1265-4277-8fb2-77646d1f7c1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:31.292376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:31.293263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:31.294085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:31.296719 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 196/390] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:31.302512 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:31.429721 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaa1b7-538e-4b18-98ac-a6b4fabbd013 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.430371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaa1b7-538e-4b18-98ac-a6b4fabbd013 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.430843 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaa1b7-538e-4b18-98ac-a6b4fabbd013 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.433572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 197/391] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:31.438625 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.439390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.439866 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.443241 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbf3d6-86a2-4549-98f7-f59382559de4 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:31.466963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:31.468590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:31.475152 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:31.493365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:31.494669 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.494965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.495243 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.495967 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:31.496273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:31.497664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:31.507223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 195/392] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:31.514353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:31.557462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 198/393] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:31.590587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:31.672236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6f40-4df0-488e-b09e-61ac5de339c2 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:31.675458 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:31.740228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:31.740806 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.741086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.741360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.742520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:31.744068 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:31.745948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 196/394] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:31 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:31.751382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:31.801606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aceb2-c7dd-4d08-abce-475ff0db9adf None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:31.818737 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:31.848027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:31.848682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.848959 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.849231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.872883 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:31.878607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51a525-7ff8-4699-9d35-35acc430cb55 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:31.880461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:31.881354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:31.882177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:31.883340 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 199/395] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:31.891905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:31.969930 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:31.971408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:31.971884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:31.972374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:31.974248 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:31.976035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:31.977999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 197/396] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:31 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:31.984090 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:32.009348 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:32.021071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d04ea-b08d-4908-94c4-496ebbbfcf79 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.093562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:32.094606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.095099 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.095744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.097269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:32.097972 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:32.100205 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:32.117351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 200/397] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:32.123967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:32.187709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955801ac-6067-4679-874a-eb7e5e791c6d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.259475 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:32.273234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:32.274236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.274734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.275255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.284072 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] RBAC: Authorizing `identity:create_grant(project_id=161f42e62554415799e108f3a19fcecd, group_id=9400ac74ae414a09945f5c5c88af6a2b, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:32.285577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:32.309863 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 198/398] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 21:43:31 2022] PUT /identity/v3/projects/161f42e62554415799e108f3a19fcecd/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:32.322675 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a32ae-e874-4b89-9f04-68a2ce324a0b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.369513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccf487-ca5f-4ace-9c6e-bbb62a4067bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:32.370574 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccf487-ca5f-4ace-9c6e-bbb62a4067bd None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.371075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccf487-ca5f-4ace-9c6e-bbb62a4067bd None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.371543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccf487-ca5f-4ace-9c6e-bbb62a4067bd None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.373043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccf487-ca5f-4ace-9c6e-bbb62a4067bd None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:32.374765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccf487-ca5f-4ace-9c6e-bbb62a4067bd None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:32.377710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 201/399] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:32 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:32.382750 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:32.390352 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb19a3-a576-4e02-86d8-314d57fd062d None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.390639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb19a3-a576-4e02-86d8-314d57fd062d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.390912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb19a3-a576-4e02-86d8-314d57fd062d None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.392604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 202/400] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:32.402250 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.402548 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.404559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.442866 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:32.444141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:32.492042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:32.573850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 203/401] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:32.581162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ee3ee-1b5f-4bf2-be22-1bc96b879093 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.600476 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:32.632065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:32.632834 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.633113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.633387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.636256 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:32.637727 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:32.639684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 199/402] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:32 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:32.645288 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:32.707315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:32.729372 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb3ab-e7ab-4cdd-9b76-763ea945d394 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.752987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a524a-fe4c-4e44-aa31-1664800c171a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.768499 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e2f2-73f0-45fa-b9ea-2462007547d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:32.769583 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e2f2-73f0-45fa-b9ea-2462007547d5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.770173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e2f2-73f0-45fa-b9ea-2462007547d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.770644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e2f2-73f0-45fa-b9ea-2462007547d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.783266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6e2f2-73f0-45fa-b9ea-2462007547d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:32.787572 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cad806-6e5c-4f40-bae3-7caad0bdb83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:32.788252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad806-6e5c-4f40-bae3-7caad0bdb83c None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.788534 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad806-6e5c-4f40-bae3-7caad0bdb83c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.788809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cad806-6e5c-4f40-bae3-7caad0bdb83c None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/d037ce24b27049d4a04b921a2fe5ec8e` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-8ba6e2f2-73f0-45fa-b9ea-2462007547d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:32.791559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:32.792505 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:32.793407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:32.794025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cad806-6e5c-4f40-bae3-7caad0bdb83c None admin] RBAC: Authorizing `identity:create_grant(project_id=d89c05fc0e264ac88dc1802f4a1fb473, group_id=9400ac74ae414a09945f5c5c88af6a2b, role_id=d037ce24b27049d4a04b921a2fe5ec8e)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:32.794025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cad806-6e5c-4f40-bae3-7caad0bdb83c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:32.796614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 204/403] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:32.800830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6172-57c2-44bc-938a-0b0ddaea9d28 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.801631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6172-57c2-44bc-938a-0b0ddaea9d28 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.801631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6172-57c2-44bc-938a-0b0ddaea9d28 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.803461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 205/404] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:32.804160 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e6172-57c2-44bc-938a-0b0ddaea9d28 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:32.816693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 200/405] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 21:43:32 2022] PUT /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/d037ce24b27049d4a04b921a2fe5ec8e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:32.817806 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:32.818035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:32.818313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:32.834418 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:32.858282 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:32.859584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:32.937819 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e6172-57c2-44bc-938a-0b0ddaea9d28 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:32.993132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 201/406] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:33.015752 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.016401 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.016675 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.016948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.017681 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:33.017984 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.019430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.023188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.037216 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 206/407] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:33.044982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.086725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:33.166879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853170-09ff-4fa3-a5f1-0e0f13b36d72 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.182187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:33.204560 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.205212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.205539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.205817 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.207780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30943e8-f844-45d7-94a0-29781c41aa6a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.217356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:33.222289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:33.223242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:33.224092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 202/408] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:33.229670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.249392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.250387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.250875 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.251396 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.252771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.254417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.256263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 207/409] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:33.263492 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.339651 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61d875-5772-477e-ae86-c162aa33a706 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.348930 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:33.371696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927203-a735-40fd-999d-0f77ccb139a8 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.381082 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.381458 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.381734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.382005 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.382713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:33.383050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.384488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.393447 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 203/410] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:33.398980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.411931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.412873 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.413354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.413828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.415219 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.417510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.419735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 208/411] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:33.425476 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.452283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:33.516923 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173f1c-4b74-4248-ae3d-b8279c8b6c7e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.573404 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.574050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.574329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.574603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] PATH_INFO: `/v3/groups/166c6eae883a4d389cadb636fd3a2f57` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.575868 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] RBAC: Authorizing `identity:get_group(group_id=166c6eae883a4d389cadb636fd3a2f57)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.577352 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.579282 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 204/412] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/groups/166c6eae883a4d389cadb636fd3a2f57 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:33.584616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.627803 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:33.649063 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e213be-51d0-4efb-b219-29be247eccf0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.727198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.727896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.728698 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.728980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/d037ce24b27049d4a04b921a2fe5ec8e` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.733086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] RBAC: Authorizing `identity:create_grant(project_id=161f42e62554415799e108f3a19fcecd, group_id=9400ac74ae414a09945f5c5c88af6a2b, role_id=d037ce24b27049d4a04b921a2fe5ec8e)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.734541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.738851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45312e24-44c8-4f26-888b-b2ba1ffe0164 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:33.781321 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 209/413] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 21:43:33 2022] PUT /identity/v3/projects/161f42e62554415799e108f3a19fcecd/groups/9400ac74ae414a09945f5c5c88af6a2b/roles/d037ce24b27049d4a04b921a2fe5ec8e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:33.788660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b17a94-548b-444d-8906-f529f907f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:33.789379 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b17a94-548b-444d-8906-f529f907f12f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.789712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b17a94-548b-444d-8906-f529f907f12f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.789991 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b17a94-548b-444d-8906-f529f907f12f None admin] PATH_INFO: `/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.792316 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b17a94-548b-444d-8906-f529f907f12f None admin] RBAC: Authorizing `identity:get_project(project_id=2eb79fbfdb0c462f815d677c4fd9d2a2)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:33.794054 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b17a94-548b-444d-8906-f529f907f12f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:33.796364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 205/414] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:33.802336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.900464 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826adfc0-c3b0-46f9-9952-b393a22d0514 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.900816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826adfc0-c3b0-46f9-9952-b393a22d0514 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.901292 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826adfc0-c3b0-46f9-9952-b393a22d0514 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.906739 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 206/415] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:33.909118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.909408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.909685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.930985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:33.933171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:33.950621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:34.015527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b137f-7a0e-4b36-bc73-5876f659f334 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:34.048585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 207/416] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:34.062602 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:34.063361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.063643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.063971 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] PATH_INFO: `/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2/groups/166c6eae883a4d389cadb636fd3a2f57/roles/068868605675478a8abe0ef53a447f78` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.066014 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=2eb79fbfdb0c462f815d677c4fd9d2a2, group_id=166c6eae883a4d389cadb636fd3a2f57, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:34.067588 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:34.086572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 210/417] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Jul 25 21:43:33 2022] PUT /identity/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2/groups/166c6eae883a4d389cadb636fd3a2f57/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:34.089810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:34.128265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:34.222174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47581f-a99b-40e3-9ebe-563d37724ff5 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:34.271033 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:34.271763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.272046 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.272429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.289805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:34.295792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:34.296894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:34.298752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 208/418] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:34.303373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:34.415869 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34671f-98ee-40b1-a19c-3e4c1c0b4b58 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:34.451508 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:34.452138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.452417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.452694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.453416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] RBAC: Adding query filter params (name=member) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:34.453719 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:34.455140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:34.456568 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:34.467590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 211/419] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:34.479055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:34.604198 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:34.616492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083c241-ed44-4c59-beee-15f420424eb3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:34.662287 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:34.662906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.663266 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.663467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.744373 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:34.745754 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:34.866948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:34.867571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 209/420] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:34.871248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:34.991895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd46116-8b7a-4791-bb2e-c786436c5932 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:35.039925 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:35.040950 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.041440 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.041915 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.043303 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:35.044978 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:35.047292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 212/421] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:34 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:35.053225 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:35.212176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471ed6-585a-4ac4-95ce-4761962862ef None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:35.258296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c76c6d-75b2-417d-8623-3981904a4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:35.258963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c76c6d-75b2-417d-8623-3981904a4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.259245 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c76c6d-75b2-417d-8623-3981904a4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.260037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c76c6d-75b2-417d-8623-3981904a4bc8 None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.261454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c76c6d-75b2-417d-8623-3981904a4bc8 None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:35.262899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c76c6d-75b2-417d-8623-3981904a4bc8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:35.264508 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 210/422] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:35.276033 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:35.336775 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d099e5-f7d9-420c-9f68-24d3cdf2fea1 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.336950 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d099e5-f7d9-420c-9f68-24d3cdf2fea1 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.337232 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d099e5-f7d9-420c-9f68-24d3cdf2fea1 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.339194 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 211/423] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:35.350606 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.350883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.351176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.374487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:35.387933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:35.389128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:35.420293 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3fda8-bc9a-4c14-a934-c8be7eae8fcf None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:35.471770 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:35.472404 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.472679 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.472944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.473723 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:35.474024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:35.475495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:35.493358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 213/424] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:35.519501 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:35.524640 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 212/425] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:35.568883 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:35.703572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2def01-368e-4f7f-b018-da8d4219e721 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:35.730789 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:35.740027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ecae3-f604-4295-809e-a4d052195747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:35.740886 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ecae3-f604-4295-809e-a4d052195747 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.741168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ecae3-f604-4295-809e-a4d052195747 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.741438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ecae3-f604-4295-809e-a4d052195747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.752369 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ecae3-f604-4295-809e-a4d052195747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-322ecae3-f604-4295-809e-a4d052195747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:35.758096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:35.759026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:35.760446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 214/426] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:35.766856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:35.818160 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4438e-3ced-4748-93a1-7dcd071c337c None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.818765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4438e-3ced-4748-93a1-7dcd071c337c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.819060 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4438e-3ced-4748-93a1-7dcd071c337c None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.820845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 215/427] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:35.826853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.827437 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.827934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.849009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:35.850533 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:35.906672 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd249e21-7654-4e22-9bca-6fe62430e23e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:35.946424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 216/428] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:35.949541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:35.949541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.949541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.949541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.949842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] RBAC: Adding query filter params (name=member) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:35.949842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:35.950670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:35.959816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 213/429] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:35.965028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:35.977768 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.043899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.089922 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69adc4e-ec91-4458-8c88-684d396ca66b None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.094301 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90010dbe-d937-40e1-a2d5-68f3aee8592e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.118260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.140032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.140664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.141545 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.141545 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.149870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.150947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.151440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.151904 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.163918 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:36.170407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:36.171346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:36.172163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:36.175036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 214/430] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:36.180493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.223031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.224962 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.294989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d497d3c-a212-4284-b24e-6c06eba70d60 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.314289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.335624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 217/431] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:36.336331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.336967 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.337240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.337537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.338271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:36.338571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.340729 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.341842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.349061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 215/432] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:36.359157 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.365718 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.453336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0bc1b-65e3-4da3-918e-2d0487f4effb None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.468084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dacc73-a491-43af-8c51-ba1cd144e83f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.504311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.504966 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.505248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.505522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.506795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.508491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.509063 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a485fc-3086-49b0-b6ca-b20f7a24f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.510300 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a485fc-3086-49b0-b6ca-b20f7a24f439 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.510575 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a485fc-3086-49b0-b6ca-b20f7a24f439 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.510839 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a485fc-3086-49b0-b6ca-b20f7a24f439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.511084 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 218/433] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:36.519895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.579870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.608198 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a485fc-3086-49b0-b6ca-b20f7a24f439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.609763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a485fc-3086-49b0-b6ca-b20f7a24f439 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.635989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.653663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c85c21-8506-4720-8e74-a1d0baeb4c3d None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.696920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.697560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.697835 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.698100 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.699873 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.701858 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.704319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 219/434] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:36.709582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.728950 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 216/435] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:36.736832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea046e-0eaf-493e-bc87-9da11fce5058 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.737118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea046e-0eaf-493e-bc87-9da11fce5058 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.737387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea046e-0eaf-493e-bc87-9da11fce5058 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.738855 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 217/436] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:36.743397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea046e-0eaf-493e-bc87-9da11fce5058 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.826407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e59b9b-f080-4519-94af-22a716d8af1b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.837347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.866422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea046e-0eaf-493e-bc87-9da11fce5058 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:36.871242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.871973 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.872267 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.872542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.873326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=abb02adff3a84d22a1b1b382e4c95e68, scope.project.id=161f42e62554415799e108f3a19fcecd) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:36.873638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.875098 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a387c6-19d5-4a7e-85c2-3f058659c21a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.881334 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 220/437] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=abb02adff3a84d22a1b1b382e4c95e68 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:36.884350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf272-d6b6-48d2-9623-77046b96389f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.885105 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf272-d6b6-48d2-9623-77046b96389f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.885380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf272-d6b6-48d2-9623-77046b96389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.906775 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b3bbf272-d6b6-48d2-9623-77046b96389f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:36.908248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b3bbf272-d6b6-48d2-9623-77046b96389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:36.909092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f3d94-73b6-45ec-94f9-17c7efd2d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:36.910003 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f3d94-73b6-45ec-94f9-17c7efd2d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.910485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f3d94-73b6-45ec-94f9-17c7efd2d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.910999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f3d94-73b6-45ec-94f9-17c7efd2d4c7 None admin] PATH_INFO: `/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.912544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f3d94-73b6-45ec-94f9-17c7efd2d4c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d89c05fc0e264ac88dc1802f4a1fb473)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:36.914284 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f3d94-73b6-45ec-94f9-17c7efd2d4c7 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:36.916709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 218/438] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/projects/d89c05fc0e264ac88dc1802f4a1fb473 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:36.920326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e2936-41a6-4887-89eb-4f8f551a91a5 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:36.920999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e2936-41a6-4887-89eb-4f8f551a91a5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:36.921547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e2936-41a6-4887-89eb-4f8f551a91a5 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:36.923140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 219/439] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:36.924143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e2936-41a6-4887-89eb-4f8f551a91a5 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:36.928361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:36.991027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 221/440] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:37.000742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.001156 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.001462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.028042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:37.029274 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:37.047521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e2936-41a6-4887-89eb-4f8f551a91a5 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.093776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.094989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.095078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.096225 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.097656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.099454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 220/441] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:36 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:37.100378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.111143 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 222/442] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:37.111809 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.118059 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.202563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.209294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3db0-6062-4a3d-93d7-ebcd73c789d5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.224739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30296-00e8-45be-a570-4fad3cf87503 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.242357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.242948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.243228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.243493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.253943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:37.258609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:37.258813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:37.260412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:43:37.261229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:37.262043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.262043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.262043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.262216 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 221/443] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:37.262288 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:37.262357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.262423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.262856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.273557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 223/444] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=d89c05fc0e264ac88dc1802f4a1fb473&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:37.273557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.358601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.389098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe5ba-23d6-4ad4-89a2-4f6011238eb9 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.399274 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4357-c79c-4da1-8ad4-d033a53ba342 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.427839 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.428490 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.428764 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.429031 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.437638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.438261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.438541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.438810 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.439560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:37.439906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.441035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:37.441227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:37.445876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:37.446864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:37.447736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 222/445] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:37.452860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.455898 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:37.461669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.467705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.585181 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfc56-1112-46ab-b754-149208bc2f1a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.601629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7ae7d-951a-405a-b646-933b88dcd2dc None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.626454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.627132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.627412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.627686 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.628394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:37.628696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.630349 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.631761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.640480 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 223/447] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:37.645551 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.645702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.646184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.646484 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.646761 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.731830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.733295 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.737753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.771540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e34e0-302b-4e7e-8b72-57085e1c1949 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.821327 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.822552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.822827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.823122 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.852218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 225/448] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:37.857916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.882754 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.890800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.892311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.957086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04877b48-7cb9-48cd-aab7-0761b8705b71 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.959339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:37.989406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 224/449] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:43:37.991471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.992107 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.992383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.992656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] PATH_INFO: `/v3/projects/161f42e62554415799e108f3a19fcecd` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.994315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] RBAC: Authorizing `identity:get_project(project_id=161f42e62554415799e108f3a19fcecd)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.995646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.995812 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.997395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 226/450] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/projects/161f42e62554415799e108f3a19fcecd => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:38.002518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:38.087403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:38.093723 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe1094-2c16-4dc1-9550-d079d8a2c2f7 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:38.100643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063ec8a-11cc-4e74-bdfe-23e2afedaa35 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:38.127807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:38.128373 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:38.128650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:38.128919 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] PATH_INFO: `/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:38.130067 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] RBAC: Authorizing `identity:get_project(project_id=2eb79fbfdb0c462f815d677c4fd9d2a2)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:38.131617 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:38.133277 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/projects/2eb79fbfdb0c462f815d677c4fd9d2a2 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:38.138738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:38.139796 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:38.140436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:38.140726 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:38.140998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] PATH_INFO: `/v3/groups/9400ac74ae414a09945f5c5c88af6a2b` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:38.142106 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] RBAC: Authorizing `identity:get_group(group_id=9400ac74ae414a09945f5c5c88af6a2b)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:38.143557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:38.145114 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:38 2022] GET /identity/v3/groups/9400ac74ae414a09945f5c5c88af6a2b => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:38.151030 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:38.194254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:38.236388 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2144ba5-a062-4577-9c14-844d43687047 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:38.250762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbce8b-2170-4375-aebc-95b5e4e733bc None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:38.268761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:38.269385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:38.269659 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:38.269924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] PATH_INFO: `/v3/groups/166c6eae883a4d389cadb636fd3a2f57` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:38.271079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] RBAC: Authorizing `identity:get_group(group_id=166c6eae883a4d389cadb636fd3a2f57)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:38.272493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:38.274045 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 226/453] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Jul 25 21:43:38 2022] GET /identity/v3/groups/166c6eae883a4d389cadb636fd3a2f57 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:38.279909 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:38.284271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:38.284884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:38.285162 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:38.285431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:38.286203 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] RBAC: Adding query filter params (group.id=9400ac74ae414a09945f5c5c88af6a2b, role.id=d037ce24b27049d4a04b921a2fe5ec8e, scope.project.id=161f42e62554415799e108f3a19fcecd) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:38.286508 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:38.287968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872d2eb-bff5-40e2-8df3-bdc1e3a77c8d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:38.294160 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 228/454] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:38 2022] GET /identity/v3/role_assignments?group.id=9400ac74ae414a09945f5c5c88af6a2b&scope.project.id=161f42e62554415799e108f3a19fcecd&role.id=d037ce24b27049d4a04b921a2fe5ec8e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:38.317804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:38.389817 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879784-4673-465a-bf1a-110564d783cc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:38.424503 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:38.425126 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:38.425399 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:38.425666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:38.426447 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] RBAC: Adding query filter params (group.id=166c6eae883a4d389cadb636fd3a2f57, role.id=068868605675478a8abe0ef53a447f78, scope.project.id=2eb79fbfdb0c462f815d677c4fd9d2a2) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:38.426749 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:38.428203 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc83c8-67b6-44aa-a4b8-ff1e805eefb9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:38.435097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Jul 25 21:43:38 2022] GET /identity/v3/role_assignments?group.id=166c6eae883a4d389cadb636fd3a2f57&scope.project.id=2eb79fbfdb0c462f815d677c4fd9d2a2&role.id=068868605675478a8abe0ef53a447f78 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:40.981409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedcd58-abd9-4878-90b5-b5bef9c7354d None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:40.981948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedcd58-abd9-4878-90b5-b5bef9c7354d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:40.981948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedcd58-abd9-4878-90b5-b5bef9c7354d None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:40.983662 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 229/456] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:40.989627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c29ca0-9ea3-4837-b56c-a7b0f63cd0bc None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:40.990600 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c29ca0-9ea3-4837-b56c-a7b0f63cd0bc None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:40.991118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c29ca0-9ea3-4837-b56c-a7b0f63cd0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.011849 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-31c29ca0-9ea3-4837-b56c-a7b0f63cd0bc None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:41.013416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-31c29ca0-9ea3-4837-b56c-a7b0f63cd0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:41.089676 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:41.115616 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedcd58-abd9-4878-90b5-b5bef9c7354d None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.155858 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821bb9d-5e03-4c8c-9867-a8b02295a1a0 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.156595 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821bb9d-5e03-4c8c-9867-a8b02295a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.157213 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821bb9d-5e03-4c8c-9867-a8b02295a1a0 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.159145 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:41.164807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdfe3e-caf6-40ee-ba47-478470260147 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.165096 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdfe3e-caf6-40ee-ba47-478470260147 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.165374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdfe3e-caf6-40ee-ba47-478470260147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.185345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-f0fdfe3e-caf6-40ee-ba47-478470260147 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:41.186550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-f0fdfe3e-caf6-40ee-ba47-478470260147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:41.217445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:41.248035 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedcd58-abd9-4878-90b5-b5bef9c7354d None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.250989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:41.270252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 230/459] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:41.287138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.288110 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.288263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0a267-2ae1-4ae2-9281-60737c3c0699 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.288672 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.288903 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0a267-2ae1-4ae2-9281-60737c3c0699 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.289187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0a267-2ae1-4ae2-9281-60737c3c0699 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.289577 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.292698 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 231/460] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:41.295766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0a267-2ae1-4ae2-9281-60737c3c0699 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.301353 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.302821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-45f9ba90-2293-418c-bd84-9873c771bd94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:41.318844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:41.319887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:41.321713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:41.321713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:41.321713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:41.321713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:41.321713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 230/461] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:41.326718 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.327029 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.327307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.345896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:41.347127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:41.417938 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0a267-2ae1-4ae2-9281-60737c3c0699 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.430969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 231/462] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:41.430969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.460500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.464516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.464797 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.465303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.480066 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.481549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:41.497039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:41.497937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:41.498887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:41.498887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:41.498887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:41.498887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:41.498887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 232/463] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:41.499638 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.512707 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:41.530506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:41.548694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fde400-102f-404c-9fe8-bcd0b31dd51f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.585086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.585705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.585978 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.586252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.586971 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:41.587407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.589310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.600426 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:41.601237 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.619234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d923-b884-46fb-89a0-e89d6df13e07 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.652841 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.653482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.653761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.654035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.664477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.666584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-10d9a263-366d-4011-bab2-35eb47cf3532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:41.680545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:41.681570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:41.682445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:41.682445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:41.682445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:41.682445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:41.682445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:41.683035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c978d0-4e59-437e-8e46-19a7a55da11a None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.683127 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c978d0-4e59-437e-8e46-19a7a55da11a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.683400 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c978d0-4e59-437e-8e46-19a7a55da11a None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.684603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 234/466] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:41.685278 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c978d0-4e59-437e-8e46-19a7a55da11a None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.704542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea48f5-37f3-47f6-ac7f-d246b717596d None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.738009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.738620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.738904 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.739208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.739885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:41.740185 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.741559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.745424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:41.753779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 233/467] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:41.754507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.762473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:41.794413 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c978d0-4e59-437e-8e46-19a7a55da11a None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.827664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c6c1b-bdb1-4117-bcf0-4f885e514cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.828285 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c6c1b-bdb1-4117-bcf0-4f885e514cc8 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.828566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c6c1b-bdb1-4117-bcf0-4f885e514cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.828839 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c6c1b-bdb1-4117-bcf0-4f885e514cc8 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.829510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c6c1b-bdb1-4117-bcf0-4f885e514cc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.830975 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c6c1b-bdb1-4117-bcf0-4f885e514cc8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.852696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 235/468] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:41 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:41.854234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.854518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.854792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.855244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba742e-69b1-476a-b9a1-21ae4effaba0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:41.875143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:41.876372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:41.910213 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:41.910856 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:41.911170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:41.911460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:41.912152 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:41.912459 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:41.913868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:41.927301 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 234/469] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:41.927971 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:41.966951 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 236/470] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:41.966951 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:42.019071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:42.025404 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:42.065731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f6c7-25ae-4e76-b75f-740c227769dd None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:42.093428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37d10e-3177-49c7-baf1-c0086b931a19 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:42.108563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:42.109499 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:42.109914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:42.110181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:42.110902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:42.113102 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:42.132280 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:42.132908 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:42.133189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:42.133460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:42.134191 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:42.139071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 235/471] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:41 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:42.139071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:42.139307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:42.164002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 237/472] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:41 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:42.276604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b8853-d71c-4a28-9e9f-9756cec629ba None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:42.304665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:42.318534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:42.319246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:42.319534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:42.319814 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:42.333781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:42.335419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:42.352897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:42.354417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:42.355409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:42.355409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:42.355409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:42.355409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:42.355409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 236/473] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:42.360856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:42.490764 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccfe05-be6a-46c1-bd50-59a68777c0d5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:42.492921 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:42.529875 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:42.530828 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:42.531359 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:42.531827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:42.532706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:42.533203 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:42.535093 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50fda-5a19-4a7b-9605-90dc6a23cbd8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:42.552172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 238/474] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:42.553792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:42.661167 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91281b5a-9f12-4824-8f81-f700ffea8663 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:42.695989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555f93-0454-48a8-b829-5d531ec214aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:42.697009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555f93-0454-48a8-b829-5d531ec214aa None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:42.697486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555f93-0454-48a8-b829-5d531ec214aa None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:42.697956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555f93-0454-48a8-b829-5d531ec214aa None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:42.698842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555f93-0454-48a8-b829-5d531ec214aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:42.700512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95555f93-0454-48a8-b829-5d531ec214aa None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:42.727116 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 237/475] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:43:42 2022] POST /identity/v3/users => generated 249 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:44.335701 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55dde-af6e-4ebc-9258-2074c0cd8bd2 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.336217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55dde-af6e-4ebc-9258-2074c0cd8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.336326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55dde-af6e-4ebc-9258-2074c0cd8bd2 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.338394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 239/476] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:44.343640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090859f2-da2d-4e0d-83fa-263ccf934848 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.344032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090859f2-da2d-4e0d-83fa-263ccf934848 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.344196 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090859f2-da2d-4e0d-83fa-263ccf934848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.362041 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-090859f2-da2d-4e0d-83fa-263ccf934848 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:44.363252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-090859f2-da2d-4e0d-83fa-263ccf934848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:44.387047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:44.437812 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 238/477] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:44.464123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55dde-af6e-4ebc-9258-2074c0cd8bd2 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:44.577454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55dde-af6e-4ebc-9258-2074c0cd8bd2 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:44.612184 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:44.612733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.613007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.613277 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.624324 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:44.629561 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:44.630474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:44.631549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 240/478] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:44.637355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:44.638314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6e4c-6057-4363-b1cb-a4bd3d7d728d None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.639024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6e4c-6057-4363-b1cb-a4bd3d7d728d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.639519 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e6e4c-6057-4363-b1cb-a4bd3d7d728d None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.641757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 239/479] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:44.647283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e10cc-ef54-4b83-83b4-851bfd49489a None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.648482 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e10cc-ef54-4b83-83b4-851bfd49489a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.648974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e10cc-ef54-4b83-83b4-851bfd49489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.664887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:44.670857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-7f2e10cc-ef54-4b83-83b4-851bfd49489a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:44.672041 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-7f2e10cc-ef54-4b83-83b4-851bfd49489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:44.740288 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 240/480] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:44.741975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071fe0-26ea-45c1-bed5-4d88b532a13d None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.742265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071fe0-26ea-45c1-bed5-4d88b532a13d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.742538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071fe0-26ea-45c1-bed5-4d88b532a13d None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.744452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 241/481] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:44.749584 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.749864 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.750140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.754824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce746fe7-2441-40a7-bc60-9e81a9081bbb None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:44.775778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:44.777161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:44.795432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:44.796642 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:44.797144 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:44.797636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:44.798589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:44.799124 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:44.800718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:44.815689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 241/482] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:44.816955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:44.870219 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 242/483] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:44.870797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:44.907152 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:44.959516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:44.970087 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc43e-385d-4d39-ad7f-2482faaf7e41 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.008367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.009002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.009363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.009631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.009727 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e3a43-5ade-4131-bb3f-6cf4ead2c0ee None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.020363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:45.025847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.026805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 242/484] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.028137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.051427 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.052534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.052534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.052834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.063712 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.065159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:45.080151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.081127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.081986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:45.081986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:45.081986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:45.081986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:45.081986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 243/485] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.082247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.158166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdc082-fdb1-4837-ac65-ca730d05f75c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.164820 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.196856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.197295 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6cf54-d30c-4308-a1f8-7630d50a7bd5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.197616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.197887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.198150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.208991 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:45.214721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.215853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 243/486] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.216692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.223786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.239117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.239732 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.240143 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.240419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.241126 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:45.241424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.242782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.251200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 244/487] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:45.252347 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.322109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87483af-00de-470e-855a-49d7ca255dc1 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.351355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc004e19-7c70-4611-af2e-fc48189cc703 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.354867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.355499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.355771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.356037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.356736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:45.357032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.358415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486063d-c6d3-4768-b73f-827813b1c656 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.371687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:45.372860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4ff75-4896-4921-9924-e74ed27f84c0 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.373139 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4ff75-4896-4921-9924-e74ed27f84c0 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.373410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4ff75-4896-4921-9924-e74ed27f84c0 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.374666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 245/489] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:45.375384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4ff75-4896-4921-9924-e74ed27f84c0 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.391283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.391906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.392187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.392462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.393178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:45.393480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.394839 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.396285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.403845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 245/490] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:45.404624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.439501 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.478816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4ff75-4896-4921-9924-e74ed27f84c0 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.505101 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267b39-709d-4ed1-82a7-29aa104bad89 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.511893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.512531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.512809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.513081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.523106 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.525522 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.537806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.538432 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.538779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.539086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-ef6bda3e-c058-4977-a0e3-8e495be93a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:45.540009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.541504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.542378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:45.542378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:45.542378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:45.542378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:45.542378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.543524 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.543804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.544076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.547375 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.548810 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:45.561066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.562308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:43:45.564194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:45.564888 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:45.564888 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:45.565075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.565075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.621113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.631494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 247/493] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:45.632469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.668902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9028d4-d51b-4972-9648-c8f796236399 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.688222 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.702654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.703252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.703532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.703795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.714422 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.715897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:45.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.730512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.731664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:45.731664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:45.731664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:45.731664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:45.731664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 247/494] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.731664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.745240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98b41-f22c-4a5b-b175-2df5da853796 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.779070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.779684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.779955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.780219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.780894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:45.781188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.782556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.794179 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 248/495] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:45.794975 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.832430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ee0c5-7ea9-458f-bab0-cea1af6583e8 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.840934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.867691 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.868303 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.868587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.869433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.870209 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:45.870510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:45.871957 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:45.897264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89fc9c-6705-4752-bbdb-4ae438e7a250 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:45.904153 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:45.907706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 248/496] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:45.908543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:45.941050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:45.941689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:45.941961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:45.942224 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:45.953128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:45.958306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:45.959356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:45.960177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:45.962077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.013075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c180d-b65e-4054-89ab-2ded5504255e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.047278 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.047885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.048159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.048423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.049096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:46.049391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.050769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.059422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5ffc-1ddd-464d-8c92-240cb5aff97e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.061449 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 249/498] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:46.062216 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.088752 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.097995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.098625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.098909 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.099204 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.107159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.108601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:46.120943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:46.122058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:46.123028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 250/499] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:46.123599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.149686 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.164400 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb225c-1d1c-484f-a6e1-02e0ced51737 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.196467 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.197110 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.197391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.197671 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.223999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dc13f-f279-4eed-b43a-ef4acf41114c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.255985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.256594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.256872 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.257141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.257852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:46.258151 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.259568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.262760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.264242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.267242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 251/500] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:46.268047 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.292335 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.352984 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.364165 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 250/501] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:46.364918 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.368919 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0498a4-32de-44b7-8c79-4062711d2abd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.402265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.402903 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.403227 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.403499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.411113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.412550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:46.423493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:46.424443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 252/502] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:46.425365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.463100 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23e8f7-723c-49f3-b243-33539bd53fb3 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.488792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.499274 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.499885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.500158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.500424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.501195 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:46.501494 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.502908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.520222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 251/503] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:46.521014 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.535345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f96da7-85bc-48bd-8229-fe2be9b00f4e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.567356 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.567986 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.568262 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.568533 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.580254 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.581698 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.590068 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:46.597423 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:46.598449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:46.599544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:46.599544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:46.599544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:46.599544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:46.599544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 253/504] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:46.599867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.620009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f141-592e-4d07-a524-99818b0e7495 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.654329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.654978 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.655265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.655536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.665487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.666967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:46.682003 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:46.682977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:46.688715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:46.688715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:46.688715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:46.688715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:46.688715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 252/505] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:46.688715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.699267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3b79-51af-458c-8e89-98e216628f03 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.719271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.732587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.733141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.733448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.733720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.734509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:46.734810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.736269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.772230 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 254/506] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:46.773036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.786158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffc61b-65d0-40c2-95ec-92d0b5a5b0e0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.818561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.819209 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.819487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.819759 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.830022 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.872358 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4e039-5dcf-440f-bb7f-da7bd1a2188f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:46.887359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.888816 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.906630 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:46.907275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:46.907554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:46.907824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:46.908511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:46.909471 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:46.910846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:46.921724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:46.922069 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 255/507] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:46.922857 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:46.990164 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 253/508] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:46.990945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.030182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55fde-41f0-4987-a606-863885535e99 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.046605 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.064199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.064816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.065102 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.065382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.066069 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:47.066371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.067793 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.079727 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 256/509] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:47.080603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.088480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ccdaf-fb90-4b7c-8954-a9ac6836c4ed None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.121205 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.121834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.122161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.122436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.126206 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.177615 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635363f6-c686-4661-bc6c-b5abb9a5778a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.189906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.191390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.211912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.213086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.213360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.213627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.220705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.222142 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:47.233548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:47.234449 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:47.235384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 257/510] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:47.235956 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.272858 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.292242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 254/511] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:47.293068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.325529 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.340619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495589-969a-4dc9-97e5-0f8ad8875aff None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.372854 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.374137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.374401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.374851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.385252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.386691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.387831 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf9690-6d53-400b-8a8c-27a6f3db1286 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:47.401116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:47.402034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:47.403296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:47.403296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:47.403296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:47.403296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:47.403296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 258/512] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:47.403797 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.425497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.426123 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.426396 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.426659 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.433092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.434521 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:47.445871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:47.447284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:47.448184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 255/513] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:47.449181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.497742 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.507853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae028f2c-290d-49e3-8f7c-7e4af1d4e04a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.540922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.541475 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.541753 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.542024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.542811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:47.543145 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.543978 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.544576 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.550392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14341b8-e674-4dd9-bbc1-5f687cf481b0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.561907 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 259/514] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:47.562709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.585863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.586506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.586785 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.587092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.598260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.599739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:47.614506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:47.615536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:47.616582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:47.616582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:47.616582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:47.616582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:47.616582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 256/515] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:47.616890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.661884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e29e0a-d7fd-460b-bc54-72157acac224 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.694406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.695063 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.695340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.695612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.696296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:47.696611 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.698527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.709506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 260/516] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:47.710122 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.720195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.720433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5708ea-1476-4d3e-8c62-7be4c7c84ebc None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.753135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.753743 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.754025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.754296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.755073 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:47.755372 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.756805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.774375 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 257/517] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:47.775234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.787749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.806631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52ab3c-d700-494f-a21a-8669d572c1f3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.839310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.839917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.840197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.840470 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.875882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036470ec-fc4c-4d69-a643-85e2bb1c5ff6 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.909879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.910160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.910625 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.910996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.911273 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.911657 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.911952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:47.912254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.913590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.921553 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.924829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 258/518] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:47.925876 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.996846 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.017525 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 261/519] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:48.018368 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.036567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4bb8a-dbff-4337-b0ba-d14a26e39cc4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.071044 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.071590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.072355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.072624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.079296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.080748 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:48.092495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:48.093542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:48.094439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 259/520] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:48.094909 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.123013 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b21e0-28aa-4762-83ef-0d49165e5ca7 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.132061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.157945 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.158555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.158832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.159397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.160175 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=baf25ec0dbf04ddf86d1c26c1266d8b9) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:48.160485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.161905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.167165 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 262/521] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/role_assignments?user.id=baf25ec0dbf04ddf86d1c26c1266d8b9&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:48.167932 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.208031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d609aa3-219e-40a0-8ef5-4abb3c47bc22 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.238514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.252236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.253075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.253442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.253811 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.263978 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.266267 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.283141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874156cb-331a-4d91-88af-169e22f44fd1 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:48.283728 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:48.284985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:48.285956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:48.293202 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 260/522] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:48.293202 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.321277 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.321879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.322158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.322435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.335871 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.337864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:48.354677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:48.355788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:48.356694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:48.356694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:48.356694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:48.356694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:48.356694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 263/523] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:48.356694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.387953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.416736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e70a54-d1b8-4de6-a4fd-6be44306d935 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.452491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.453636 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.453928 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.454397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.455305 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:48.455621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.457710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.473351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 261/524] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:48.476969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7b73-0cac-4542-9ee2-bd2fe7da287d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.479581 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.513633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.514615 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.515143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.515489 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.516311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:48.516621 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.518076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.530431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.538959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 264/525] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:48.543814 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.587730 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c11916-9799-4130-817b-4a912f0fbb64 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.626862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.627515 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.627792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.628063 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.628770 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:48.629078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.630461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.637215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.647078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 262/526] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:48.647078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.656491 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16c5f6-b387-4437-91d7-34b99c17fbbd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.696065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.697078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.697432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.697709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.698495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=f785ecee24d24cd4941c744c4ad17a23) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:48.698812 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.700287 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.706159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 265/527] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/role_assignments?user.id=f785ecee24d24cd4941c744c4ad17a23&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:48.711891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.760687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102b13-c06d-4139-b507-d0e8a4e5bb0e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.771640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:48.800920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.801555 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.801832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.802104 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.802914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=69b30a7d7bf84bf993efa9444b9a419f) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:48.803254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.804735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.818961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 263/528] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/role_assignments?user.id=69b30a7d7bf84bf993efa9444b9a419f&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:48.864947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1c85c-a9e8-4c7e-aa7a-4606da167444 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.906039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.906696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.907011 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.907289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.915985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.917632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:48.931140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:48.932627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:48.933493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 266/529] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:48.939256 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:49.058620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b2c1-b523-493d-b9d9-174e730200f9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:49.094220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:49.094822 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:49.095146 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:49.095425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:49.096175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:49.096483 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:49.097927 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb8f9d-8f3a-442f-ac85-4826ba687f38 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:49.111408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 264/530] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:49.117689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:49.130454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:49.226321 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27d794-1d06-491e-81f2-f3d56289e8db None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:49.262708 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:49.263364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:49.263646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:49.263922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:49.264710 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=7ae653f590784ee894b3d00dd83790f3) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:49.265017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:49.266455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6114617-d297-48fa-86e3-b0fbf8d8df23 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:49.272509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 267/531] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:49 2022] GET /identity/v3/role_assignments?user.id=7ae653f590784ee894b3d00dd83790f3&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:50.386001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c1c4-ae29-4bcf-b54a-257309e8fedf None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:50.386526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c1c4-ae29-4bcf-b54a-257309e8fedf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:50.386526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c1c4-ae29-4bcf-b54a-257309e8fedf None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:50.388135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 265/532] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:50.393571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:50.393987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:50.394184 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:50.412414 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:50.413590 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:50.487773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 268/533] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:50.511660 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c1c4-ae29-4bcf-b54a-257309e8fedf None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:50.545605 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:50.621946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c1c4-ae29-4bcf-b54a-257309e8fedf None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:50.658785 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:50.659924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:50.660364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:50.660800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:50.672208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:50.677225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:50.678307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:50.679263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:50.680603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 266/534] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:50.688034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:50.690199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:50.796607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa523e97-53ed-4952-ba94-1998d56ca856 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:50.835156 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:50.835800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:50.836081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:50.836523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:50.837383 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:50.838188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:50.839751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bca47-6499-4728-b48f-cc6d4c374ce7 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:50.852455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 269/535] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:50.854792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:50.955734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:50.966517 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d94125-68c5-4159-bbb4-19ee9203083f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:50.970018 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99eab3-ec3a-4597-828d-5e5d5d8ceb84 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:50.970166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99eab3-ec3a-4597-828d-5e5d5d8ceb84 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:50.970408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99eab3-ec3a-4597-828d-5e5d5d8ceb84 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:50.972041 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 270/536] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:50.977442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:50.977442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:50.977651 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:50.996976 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:50.998439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:51.008562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.009997 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.010532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.011021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.022797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.024576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:51.040350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:51.041490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:51.042573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:51.042573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:51.042573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:51.042573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:51.044510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 267/537] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:51.050954 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.096340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.101594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 271/538] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:51.126119 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.171072 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a597cc-c8f2-40bc-9347-669762af5dd2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.209833 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.210357 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.210638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.210910 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.211628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:51.211931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.213847 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78934-5d9f-413b-a53a-db910d04880f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.227205 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 268/539] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:51.228559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96c8ff-7e13-4af9-8a95-5bfdf3e85575 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.228842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96c8ff-7e13-4af9-8a95-5bfdf3e85575 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.229115 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96c8ff-7e13-4af9-8a95-5bfdf3e85575 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.230534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 269/540] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:51.232731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96c8ff-7e13-4af9-8a95-5bfdf3e85575 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.237232 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.247476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c052a-60b8-4efd-97cf-c2832c47fc48 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.282351 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ffd65-c3d9-41eb-8d67-92a6affc461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.283025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ffd65-c3d9-41eb-8d67-92a6affc461e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.283291 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ffd65-c3d9-41eb-8d67-92a6affc461e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.283558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ffd65-c3d9-41eb-8d67-92a6affc461e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.295200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ffd65-c3d9-41eb-8d67-92a6affc461e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-081ffd65-c3d9-41eb-8d67-92a6affc461e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:51.300258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:51.301171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:51.301983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 272/541] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:51.303325 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.303325 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.303325 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.321209 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:51.322979 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:51.352251 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96c8ff-7e13-4af9-8a95-5bfdf3e85575 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.383597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.389913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.390555 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.390837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.391130 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.398482 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.400105 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.404608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 273/542] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:51.405264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:51.421397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:51.422383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:43:51.423879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:51.427264 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 270/543] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:51.428111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.505354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.523064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c32bd6-88d2-464b-baea-ad94408539e2 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.546787 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62f6b-e22c-48a9-a903-b8f1724edb76 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.559216 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.559837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.560111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.560382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.561092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:51.561386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.562735 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.570948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 274/544] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:51.571748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.588264 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.589161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.589682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.590098 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.600778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:51.607460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:51.608527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:51.609537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:51.611495 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 271/545] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:51.612383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.624064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.684019 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25df4-05fa-4015-aef3-9254af18f239 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.716093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c470d0-f64d-4563-9909-fa76b54dd895 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.716242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.716853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.717126 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.717395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.718171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:51.718476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.719917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.736999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 275/546] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:51.737717 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.745854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.756731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.757361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.757639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.757909 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.768329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.769762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-bc7a4ced-be9d-4a0f-aa8a-47469b4d9e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:51.783532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:51.784844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:51.785916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:51.785916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:51.785916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:51.785916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:51.785916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 272/547] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:51.786254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8594ee-1b72-4d1d-b74b-864553ba8f2c None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.786334 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8594ee-1b72-4d1d-b74b-864553ba8f2c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.786552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8594ee-1b72-4d1d-b74b-864553ba8f2c None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.791108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 273/548] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:51.791108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8594ee-1b72-4d1d-b74b-864553ba8f2c None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.840631 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d4a58-208c-4889-9b6a-c0460f95db8e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.842860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:51.875097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.875533 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.875810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.876080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.877283 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:51.877850 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.878966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.886901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 276/549] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:51.887524 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:51.890914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8594ee-1b72-4d1d-b74b-864553ba8f2c None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.925534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:51.926256 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.926603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.926977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.938591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:51.940076 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-cdaa9c70-33dc-4037-87ca-4ba2882fdc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:51.953889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:51.954967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:51.955890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:51.955890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:51.955890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:51.955890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:51.955890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 274/550] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:51.956174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:51.956514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:51.956777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:51.974285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:51.975506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:51.990535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b28f55-5962-47a9-b4ff-9aeee4d37273 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:51.998290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.030811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.031469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.031747 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.032020 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.032711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:52.033012 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.034650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.044448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 275/551] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:52.045269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.046118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 277/552] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:52.046901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.077516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.148326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d915-9475-4613-bc0e-9d188bf74aac None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.150032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da2a30-cf35-4435-aa7c-0b5735af5535 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.183494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.184108 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.184290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.184407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.184644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.184925 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.185202 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.185329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:52.185473 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.185633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.187017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.196778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.198677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 278/553] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:52.198784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.199331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:52.213528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:52.214598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:52.215739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:52.215739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:52.215739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:52.215739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:52.215739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 276/554] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:52.215739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.231105 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.285071 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.300176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0582ed-e3bb-4500-a2b8-7cb170a110e2 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.318907 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32328e-7fb8-43ec-a942-67e3324469a5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.333102 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.333751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.334022 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.334295 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.342199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.343663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.352011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.352638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.352913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.353182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:52.354612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:52.355766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 279/555] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:52.356712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.368455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:52.373715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:52.374893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:52.375998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:52.381629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 277/556] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:52.381629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.450779 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.455897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dd96-c9e1-4a34-ba5c-9a72f79efbc6 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.482834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f396c-3122-4f1b-866b-dfa948162738 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.492724 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.493358 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.493666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.493937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.500433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.501869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:52.513410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:52.514307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:52.516131 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 280/557] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:52.516628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.516726 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.516808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.516808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.516808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.517000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:52.517269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.518568 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.528105 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.531042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 278/558] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:52.531836 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.620167 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812bad-be86-411f-9f8e-54acc54b36ea None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.626182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaafb2f-c457-4968-b83a-08daae3f1dd3 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.653073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.653684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.653965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.654240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.655058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:52.655384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.657299 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.657428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.670171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.670795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.671109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.671382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.672096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:52.672395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.673758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.684275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 281/559] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:52.685116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.690198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 279/560] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:52.690908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.749654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.786666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2db39-7d0e-4c7d-97c8-f8b4224e43d5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.791988 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87280e7b-60e3-49ae-a0d9-eb79f5a55a77 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.819963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.820569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.820846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.821117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.822491 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:52.822796 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.824271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.825504 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.826136 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.826414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.826696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.834173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.835387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 282/561] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:52.835643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.836209 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:52.847279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:52.848261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 280/562] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:52.849234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.899538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.939518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2499b3-bddc-44aa-920f-15c29838cf0e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.947441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7056cd-f2e8-461b-bcdd-56939b8cc854 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.962382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:52.973767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.974397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.974669 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.974962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.980113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.980746 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.981025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.981299 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.985174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.986611 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.991465 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.992923 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:53.000911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:53.001953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:53.002877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:53.002877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:53.002877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:53.002877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:53.002877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 283/563] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:53.003520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:53.007258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:53.008294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:53.011323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:53.011323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:53.011323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:53.011323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:53.011323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 281/564] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:53.011323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.135321 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d943-0879-4c87-a48c-09fccde7e6ac None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.139427 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cab8b-dfb5-46dc-8508-c6449c7fbc50 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.141657 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.170009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.170604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.170883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.171187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/baf25ec0dbf04ddf86d1c26c1266d8b9/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.173250 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.174016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.175040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.175319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.176092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:53.176392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.177807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.185076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=baf25ec0dbf04ddf86d1c26c1266d8b9, role_id=a4a707fcc1cc4a519d6f39cbcc5ce7fe)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.186498 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.194677 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 282/565] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:53.195772 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.204088 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 284/566] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:53 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/baf25ec0dbf04ddf86d1c26c1266d8b9/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:53.205121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.247560 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.304384 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c8c8-c799-472f-9370-548e0fc598d5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.332776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7c73-30f6-40bf-b0f2-8d404739ebce None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.344521 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.345164 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.345444 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.345724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.346428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:53.346738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.348191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.360535 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 283/567] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:53.361305 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.375925 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.376548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.376846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.377088 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.377778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:53.378079 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.379485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.393373 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 285/568] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:53.394557 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.395385 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.483816 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9486e0-4cbc-4d26-bac7-43491c880e4c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.489376 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.510640 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6090-6af3-4373-b4c1-387e976130f3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.518809 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.519486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.519764 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.520038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.531627 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.533088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:53.547920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:53.549040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:53.549951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:53.549951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:53.549951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:53.549951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:53.549951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:53.549951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.555660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.556878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.557155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.557428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.564680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.566139 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:53.578906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:53.579866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 286/570] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:53.580845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.633643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.662430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72a0c0-cc14-44d4-9492-1abe8494c31b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.685286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867887c-51ce-4924-8d7e-3f7f6cd56422 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.698366 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.699227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.699888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.700169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.709263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.710944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.719742 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.720412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.720686 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.720955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.721673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:53.721975 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:53.722852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:53.723840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:43:53.730147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:53.730823 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.730947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 285/571] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:53.730947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.743559 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 287/572] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:53.744463 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.754029 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.837351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78ca4-6266-4acd-b234-f86e769fa1e1 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.853769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b561b9a-7401-47c3-987d-28577894ee39 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:53.873541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.874249 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.874539 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.874809 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.875572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:53.875872 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.878296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.879068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:53.890129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:53.890773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:53.891084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:53.891359 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:53.892154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:53.892460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:53.897674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 286/573] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:53.897674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.897871 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:53.917043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:53.917043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:53.991005 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:54.009450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19282b-25fd-4715-bb53-d882858cc01f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.034792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46115fd4-b3ae-4024-85da-62e40c5dd93b None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.048275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.049041 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.049318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.049589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.069963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.069963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:54.081733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:54.082823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:54.084068 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:54.084912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:54.085706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.091384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.092170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.092544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.092912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/f785ecee24d24cd4941c744c4ad17a23/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.120232 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=f785ecee24d24cd4941c744c4ad17a23, role_id=a4a707fcc1cc4a519d6f39cbcc5ce7fe)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.121747 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.137418 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 289/576] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:53 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/f785ecee24d24cd4941c744c4ad17a23/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:54.138326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.180017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:54.249483 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275a334-065b-4f95-b9f6-649e407d6255 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.271331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb69f35-7b03-4c02-b7ef-7417a1aa518f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.292988 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.293671 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.293951 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.294272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.294762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:54.307903 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.309757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:54.328168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:54.329309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:54.330389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:54.330389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:54.330389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:54.330389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:54.333083 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:54.338114 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.338394 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.339218 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.339658 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.340069 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.340959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:54.341401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.344162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.360298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:54.367431 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.454144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95621c9-6f55-4269-9b24-a7701444f58f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.466744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:54.486073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8c99-35ae-4989-8f9f-67a44002568b None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.504138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.505335 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.505761 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.506177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.507145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:54.507624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.509242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.522174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:54.523704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.525422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.525877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.526310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/69b30a7d7bf84bf993efa9444b9a419f/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.528280 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.546850 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=69b30a7d7bf84bf993efa9444b9a419f, role_id=a4a707fcc1cc4a519d6f39cbcc5ce7fe)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.549198 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.566995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 291/580] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:54 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/69b30a7d7bf84bf993efa9444b9a419f/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:54.658837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2fb9-46f2-40d8-a3cc-1ad06bab5e97 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.703076 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.703741 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.704064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.704341 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.712212 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.714344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:54.727240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:54.729221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:54.730194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:54.735108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:54.737874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.767032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:54.853406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270cff1-b075-4187-9b22-81bd21b9491c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:54.889706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:54.890330 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:54.890628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:54.890883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:54.891673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:54.891968 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:54.893407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc6602-60ab-4cea-a12b-364dc6b98e47 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:54.910839 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:54.912315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:54.942720 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:55.020448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228b3d4-2795-4b0d-a64b-02e09ca7c46c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:55.059483 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4be99a-934c-4eaa-9006-e174d996428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:55.060146 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4be99a-934c-4eaa-9006-e174d996428d None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:55.060420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4be99a-934c-4eaa-9006-e174d996428d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:55.060687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4be99a-934c-4eaa-9006-e174d996428d None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/7ae653f590784ee894b3d00dd83790f3/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:55.076231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4be99a-934c-4eaa-9006-e174d996428d None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=7ae653f590784ee894b3d00dd83790f3, role_id=a4a707fcc1cc4a519d6f39cbcc5ce7fe)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:55.077659 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4be99a-934c-4eaa-9006-e174d996428d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:55.092553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 291/583] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:43:54 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/7ae653f590784ee894b3d00dd83790f3/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:55.521156 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a449c7c-39c7-45f0-853b-442d638d9952 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:55.521499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a449c7c-39c7-45f0-853b-442d638d9952 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:55.521717 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a449c7c-39c7-45f0-853b-442d638d9952 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:55.523369 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 293/584] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:55.529089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:55.529547 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:55.529631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:55.548849 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:55.550041 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:55.621033 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 292/585] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:55.645097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a449c7c-39c7-45f0-853b-442d638d9952 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:55.737601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:55.756129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a449c7c-39c7-45f0-853b-442d638d9952 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:55.792317 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:55.793341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:55.793830 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:55.794310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:55.805028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:55.810587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:55.811599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:55.812493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:55.815144 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:55.828067 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:55.843984 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:55.940597 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cf14-3f57-4819-a135-0b31aecbb0e2 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:55.979482 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:55.980682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:55.981183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:55.981666 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:55.982587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:55.983211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:55.984808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:55.994199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:56.002015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.106431 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e6ba-78ab-4f1d-9680-f17c95effd06 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:56.141262 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:56.141908 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.142185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.142460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.153736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:56.155241 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:56.158219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:56.171881 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:56.172851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:56.173774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:56.173774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:56.173774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:56.173774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:56.173774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:56.180258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.252827 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:56.290993 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa289ef-15d6-4156-a918-037b121f3e4a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:56.330363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639344-31d8-4052-bac4-db3522946900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:56.331470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639344-31d8-4052-bac4-db3522946900 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.331980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639344-31d8-4052-bac4-db3522946900 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.332458 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639344-31d8-4052-bac4-db3522946900 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.333359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639344-31d8-4052-bac4-db3522946900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:56.333865 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639344-31d8-4052-bac4-db3522946900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:56.335567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639344-31d8-4052-bac4-db3522946900 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:56.349004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:56.356002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.480746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c9273-d3c9-49fa-99b8-f8f254a52bd1 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:56.515253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:56.515813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.516092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.516362 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.524121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:56.526097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-2466f416-5b27-4e35-9463-c5a6e1234d82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:56.537577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:56.538569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:56.540129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:56.547209 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639344-31d8-4052-bac4-db3522946900 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.555255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1426-9049-4221-b884-3840d4c4c063 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.555536 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1426-9049-4221-b884-3840d4c4c063 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.555813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1426-9049-4221-b884-3840d4c4c063 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.557902 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 297/591] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:56.563051 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.563365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.563560 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.582983 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:56.584295 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:56.639884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:56.658640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639344-31d8-4052-bac4-db3522946900 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:56.667533 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 298/592] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:43:56.685648 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.687724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:56.696042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:56.697079 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.697693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.698175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.699326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:56.699734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:56.701266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:56.719598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 295/593] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:56.725259 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.810878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023d5e4-4368-4687-9536-818ff58a882e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:56.842315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ee48c-5411-477a-a80b-818b006d1dc5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:56.848868 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:56.849765 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.850213 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.850648 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.864375 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:56.870453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:56.871665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:56.872530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:56.880257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 299/594] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:56.881634 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:56.885076 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db734e33-2280-4c4d-8e22-14a6b2738ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:56.885872 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db734e33-2280-4c4d-8e22-14a6b2738ee6 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:56.886132 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db734e33-2280-4c4d-8e22-14a6b2738ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:56.886497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db734e33-2280-4c4d-8e22-14a6b2738ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:56.934953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:56.945350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:56.961079 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db734e33-2280-4c4d-8e22-14a6b2738ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:56.962850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db734e33-2280-4c4d-8e22-14a6b2738ee6 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:56.994743 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f40a7-f3d1-4968-aa59-530b3e8be73b None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.031770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.032385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.032659 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.032926 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.033636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:57.033934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.035591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702869-35b3-464a-a96a-75bfcfe79c03 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.043797 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 300/595] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:57.045006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027721d5-a509-4c35-80da-c560b482845f None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.045285 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027721d5-a509-4c35-80da-c560b482845f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.045552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027721d5-a509-4c35-80da-c560b482845f None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.046891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 301/596] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:57.049163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027721d5-a509-4c35-80da-c560b482845f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.080868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 296/597] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:43:57.080868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.080868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.080868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.096931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:57.098125 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:57.173923 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 297/598] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:57.175800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.197703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027721d5-a509-4c35-80da-c560b482845f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.199727 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.209716 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.238382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.239468 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.239740 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.240025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.251604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.253702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:57.268602 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:57.269515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:57.270405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:57.270405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:57.270405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:57.270405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:57.270405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 302/599] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:43:57.271463 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.291979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8757fe0-daf0-4f1e-9133-14a5c988c018 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.334067 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.334627 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.334960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.335231 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.346969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.348562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:57.365088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:57.365992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:57.366899 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:57.366899 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:57.366899 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:57.366899 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:57.371056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 298/600] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:57.371895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.379868 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fe089-c254-48f1-9170-2b0efec22ee5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.413944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.414621 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.414901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.415202 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.426012 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:57.431407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:57.432378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:57.433337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 303/601] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:57.435771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.450099 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.460083 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.495596 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ae95-1073-4585-8690-4d360ae8d7de None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.528880 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.529490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.529768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.530047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.530733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:57.531062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.532423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.541305 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249daedc-fcb0-4bf1-a713-37d6ee7f4842 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.544468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 299/602] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:57.545249 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.574793 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.575433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.575714 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.575992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.576680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:57.576984 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.578353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d598ba-b463-4c63-94f7-d6cbe518610b None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.589769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 304/603] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:57.590959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f05e-87ba-49a3-8012-dbbfe3b67d5b None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.591251 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f05e-87ba-49a3-8012-dbbfe3b67d5b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.591525 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823f05e-87ba-49a3-8012-dbbfe3b67d5b None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.592716 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 305/604] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:43:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:57.593403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823f05e-87ba-49a3-8012-dbbfe3b67d5b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.647682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136376-cbbd-4199-b970-145fd91fe5f9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.673447 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.673597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.682266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.682873 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.683173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.683440 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.684140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:57.684434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.685788 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.693557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 300/605] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:57.694340 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.695341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823f05e-87ba-49a3-8012-dbbfe3b67d5b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.728901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.729532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.729805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.730076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.736850 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.738272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-1689a005-cac7-452a-ba24-d1f264a336d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:57.749977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:57.751027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:57.752034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 306/606] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:57.752915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.752915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.752915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.769879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:57.771073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:57.796525 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1253d4-a773-46f6-9073-a3ce2885d5e0 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.829491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.830120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.830395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.830681 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.834680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 307/607] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:43:57.835523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.837160 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.838622 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:57.849777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:57.850667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:57.851914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:57.852702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 301/608] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:57.854708 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:57.904992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.916608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:57.948383 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb168ae-d2fa-45ff-add7-02401a2dd93d None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.957347 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ab5c6-b33d-4643-a345-905242513d49 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:57.981605 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.982241 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.982515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.982785 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.990749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:57.991388 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:57.991667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:57.991938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:57.992707 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:57.992818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.993011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:57.994215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:57.994433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:58.008455 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:58.009505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:58.010593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:58.010593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:58.010593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:58.010593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:58.010593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 308/609] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:58.010593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.012509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 302/610] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 21:43:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:58.013162 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.111870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba4bf4-abec-4752-a594-066dfa70ca16 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.112249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5767216-c645-4d9e-a737-4f3ea0a5a828 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.121240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.135669 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.146557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.147226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.147394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.147503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.147764 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.147997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.148273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.148539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.149264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:58.149563 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.151037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.158102 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:43:58.162743 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 309/611] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:43:58.163230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:58.164124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:43:58.164967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:58.165682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.165765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 303/612] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:58.165765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.263035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71871-68d9-4fb7-a5d1-9b621769cd19 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.265122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12347a4f-b24a-499c-94f1-4cada112a4a4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.296998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.297834 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.298112 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.298382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.298503 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.299010 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.299126 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:58.299287 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.299390 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.299552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.300736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.313306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 310/613] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:58.314096 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.338904 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.357170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.371284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.372655 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.412795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1318f3-6a8d-4780-9f0a-259274121feb None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.444137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.444733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.445014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.445283 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.446044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=baf25ec0dbf04ddf86d1c26c1266d8b9) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:58.446348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.448326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.453818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 311/614] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/role_assignments?user.id=baf25ec0dbf04ddf86d1c26c1266d8b9&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:58.454570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.479884 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 304/615] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:58.484107 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.563452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.579912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f0fd1-8f48-4364-97b1-caf5137b0534 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.589448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.601451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ff8f-5186-42b8-945e-2c657c50b754 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.621548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.622092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.622370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.622651 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.623407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:58.623715 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.625166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.635460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 312/616] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:58.635737 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.644472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.645302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.646137 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.647742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.656009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.657649 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:58.670986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:58.672001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 305/617] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:58.673371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.749580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72577bee-d167-490e-9fb4-7c443f6f655e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.788036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.788259 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94333fb9-b89f-44ec-acc2-aace6993b099 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.788681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.788957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.789226 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.805540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.807211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.816321 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:58.822562 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:58.823544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:58.829570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:58.829570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:58.829570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:58.829570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:58.829570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 313/618] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:58.829570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.832446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.833093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.833367 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.833636 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.845229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.846694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:58.853922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:58.861638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:58.862559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:58.863609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:58.863609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:58.863609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:58.863609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:43:58.863609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 306/619] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:58.863609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:58.940891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bea65-f3b6-4351-a406-f18661ca2b15 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.970747 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e719-2ae2-402e-aaa1-5299cff383d3 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:58.978901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:58.979550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:58.979850 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:58.980104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:58.980891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:58.981196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:58.982626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.008714 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 314/620] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:59.008714 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.012270 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.012896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.013173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.013446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.014135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:59.014436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.015832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.028121 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 307/621] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:59.028841 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.069860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.104869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.129181 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866a534-74c8-4062-be87-157c6105ddfb None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.137718 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152154df-5a56-4a80-9595-16ad39f0cbf7 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.165826 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.166450 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.166736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.167048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.167737 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:59.168055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.169409 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.173909 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.174715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.175183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.175601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.182125 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 315/622] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:59.182957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.250312 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.251797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.289796 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5c41-5e7c-4a49-81cc-e50d59be8b71 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.293950 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.326209 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.326899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.327221 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.327498 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.335382 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.336828 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.339180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:43:59.349721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:59.350656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 316/623] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:59.352190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.361850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 308/624] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:43:59.362820 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.461376 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de730ef-1eb9-4684-b242-457ecb659c7f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.475308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77a4c-7fdd-4708-9376-f9d60de2d20c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.502691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.503452 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.504042 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.504042 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.513966 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.514724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.515151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.515520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.516332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.516443 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:59.516859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.517923 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.518437 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.528481 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:43:59.531811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:59.532998 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:43:59.534186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:59.538037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 317/625] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:59.538865 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.540583 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 309/626] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:59.541417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.602974 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.647069 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeeddda-aab2-4e2b-bdfb-2e7d4cfa12b4 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.650395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fcf3a-0c50-4c18-baeb-53e16ceef10e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.684681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.685333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.685610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.685883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.686989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.687606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.687885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.688153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.688935 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:59.689237 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.690653 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.698041 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.699600 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.708894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 310/627] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:59.709542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:43:59.718767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:43:59.719874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:43:59.720776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:43:59.720776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:43:59.720776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:43:59.720776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:43:59.720776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 318/628] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:43:59.720776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.772931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.827912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b635360-8e72-42f9-8db9-a1b66a09b2c2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.832767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9679-c688-4793-b57d-c3ee638f91dc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:59.845416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:59.871521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.872133 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.872408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.872736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.873871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:59.874488 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:59.874769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:59.875337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:59.876994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=f785ecee24d24cd4941c744c4ad17a23) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:59.877313 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.878744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:59.887831 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 311/629] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/role_assignments?user.id=f785ecee24d24cd4941c744c4ad17a23&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:43:59.888533 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:59.967432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:59.970092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.032668 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bf3e5-8b42-43d9-83c6-30be8552cb4f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.065247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:00.088262 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.088928 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.089207 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.089487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.090956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:00.091140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.094667 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.104580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 319/630] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:44:00.111992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.114283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 312/631] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:00.119925 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.128790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:00.240531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37558-7c9c-45ca-b805-34f9f9b9d0f9 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.253566 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b30b7-4cf7-4c55-9162-f17dadf97ff2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.287024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.287604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.287879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.288401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.299312 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.299965 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.300246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.300519 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.301736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.303384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.309095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.310535 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:00.319933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:00.321057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:00.322121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:00.322121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:00.322121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:00.322121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:00.323990 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 320/632] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:44:00.324406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:00.325421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:00.326538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 313/633] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:00.332269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.332516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.396244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:00.398304 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:00.453007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142b428-b5b0-4591-983f-bc16e06a1533 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.462075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d99181-3a86-44c8-8b14-d2c22d177871 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.501773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.503065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.503573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.504007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.504987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:00.505601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.506731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.507444 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.507559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.508052 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.508415 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.509290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:00.509742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.511248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.523389 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 321/634] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:00.530561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 314/635] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:00.530707 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.530799 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.638489 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3d48a-b693-4c26-8cb8-e91eff35aaee None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.664786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be264e-5c09-4661-afd0-42d2584786be None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.668412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:00.671693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:00.688892 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.690111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.690565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.691245 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.701863 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.703324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.703977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.704094 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.704358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.704704 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.705548 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=69b30a7d7bf84bf993efa9444b9a419f) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:00.705926 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.707708 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.714714 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 315/636] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/role_assignments?user.id=69b30a7d7bf84bf993efa9444b9a419f&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-77319d04-5917-4ff0-afd7-158306e8fe6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:44:00.718416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:00.719415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:00.720340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 322/637] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:00.727614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.792105 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a484-17c6-4e0d-890c-5860bee83e59 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.792443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a484-17c6-4e0d-890c-5860bee83e59 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.792647 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a484-17c6-4e0d-890c-5860bee83e59 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.798260 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 323/638] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:00.800192 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.800476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.800746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.822142 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:00.823932 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:00.857439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c93837-b7bf-4b29-a4e6-daa59456c6cc None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:00.903073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 324/639] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:44:00.905521 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:00.906140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:00.906416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:00.906683 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:00.907464 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:00.907769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:00.909182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:00.923151 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.924562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 316/640] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:00.930028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:00.962313 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.044954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6d0cc-3dc6-4a5f-9af4-860a3a16161a None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.059884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.062697 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aef50e-a2cd-4285-8ee8-aba24fde4601 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.083663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.084367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.084718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.084984 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.096582 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:44:01.102289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:01.103862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:44:01.105223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:01.105928 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.106207 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.110940 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.110940 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.111169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 325/641] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:01.111248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=7ae653f590784ee894b3d00dd83790f3) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:01.111248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.111375 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.111453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.119513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 317/642] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:44:00 2022] GET /identity/v3/role_assignments?user.id=7ae653f590784ee894b3d00dd83790f3&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:01.234023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dab05a-438a-4814-9631-2e3042b7e152 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.273275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.273913 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.274196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.274470 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.275744 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:01.276149 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.277550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.287845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 326/643] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:01.293851 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.401243 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.414813 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c11d7-6554-4ec4-b3b0-b1ae538f6a42 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.449798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.450433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.450705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.450996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.461625 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.463131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:01.481390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:01.482317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:01.483285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:01.483285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:01.483285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:01.483285 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:01.487168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 318/644] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:01.488503 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.525542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.598429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736dba8-2d5a-41d6-b033-1fedbb9af798 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.633626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.634758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.635069 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.635340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.636018 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:01.636315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.637676 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.649794 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 327/645] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:01.655760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.765369 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad0e73-5bab-419c-bcef-a04af2691f3e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.802876 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.803546 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.803817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.804082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.812409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.813840 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:44:01.826760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:01.827749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:44:01.828702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:01.832499 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 319/646] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 21:44:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:01.833824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.929846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:01.938319 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809fab-fc39-4c11-b662-314b6f3c7ce0 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.973712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.974332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.974605 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.974872 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.975699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:01.975996 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.977422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.995964 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 328/647] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 21:44:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:02.001401 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.004545 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:02.109550 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daac19-3051-45b8-a63c-7bcfe07f0874 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.146549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c065a7c-9bac-4aaa-92c9-b06c5e5fb5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.147540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c065a7c-9bac-4aaa-92c9-b06c5e5fb5b8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.148041 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c065a7c-9bac-4aaa-92c9-b06c5e5fb5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.148507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c065a7c-9bac-4aaa-92c9-b06c5e5fb5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.218290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c065a7c-9bac-4aaa-92c9-b06c5e5fb5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.220143 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c065a7c-9bac-4aaa-92c9-b06c5e5fb5b8 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.222121 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:02.329547 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 320/648] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:44:02.335308 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.436265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3aed-1b5b-4868-9c34-05c8fb72bda4 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.436569 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3aed-1b5b-4868-9c34-05c8fb72bda4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.436819 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3aed-1b5b-4868-9c34-05c8fb72bda4 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.438307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 321/649] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:02.442409 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937575-517c-42d9-b8ca-976c6f29aeaf None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.443742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.444023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.444294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.468581 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:02.470194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:02.486170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.486817 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.487121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.487389 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.498823 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.500644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:02.517064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:02.518044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:02.518965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:02.518965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:02.518965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:02.518965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:02.521168 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 329/650] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:02.529437 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.533535 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:02.566962 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 322/651] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:44:02.582497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.616881 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:02.646269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377ad53-3728-4434-bd75-a277fa3f405a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.683293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.684264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.684742 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.685284 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.686263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:02.686817 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.688536 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.694662 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f06baf-c872-4781-9b81-fdac66f88b6b None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.702582 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 330/652] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:02.708032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.731890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.732211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.732489 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.732766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.733391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.734751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:02.746815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:02.747859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:02.748717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:02.752888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 323/653] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:02.753850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.781203 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:02.824037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3810a-ece1-4651-8321-a1296a8c2c46 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.859839 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:02.865015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.865870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577bde3-fec8-4374-8750-8aecf36cd27f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.866170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.866589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.867027 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.875255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.877002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:44:02.889326 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:02.890263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:02.891286 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:02.893589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 331/654] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:02.899866 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.906111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.907021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.907533 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.908079 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.909139 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:02.909910 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.911700 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.917924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 324/655] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:02.923275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:03.026378 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698720c-e8df-48da-8aee-5af95418c869 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.040120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6a13-3edb-46f8-b071-3f2a0c00b4e2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.051571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:03.065261 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.066212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.066731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.067217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.068102 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:03.068577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.070309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.074778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.075431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.075705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.075973 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.076640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:03.076938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.078282 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5f4e-1be3-4129-b05d-bfbb117f0289 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.085545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 332/657] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:03.086979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 325/657] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:03.091882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:03.126088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df94a-31a4-4dcb-b6e2-d3b55b1aa628 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.126395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df94a-31a4-4dcb-b6e2-d3b55b1aa628 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.126939 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df94a-31a4-4dcb-b6e2-d3b55b1aa628 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.128240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 326/658] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:03.139851 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.141393 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.141824 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.167451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:03.169624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:03.197150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:03.216883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe033ee2-73ef-485c-bf08-7d273b1235c0 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.266492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.267542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.268028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.268526 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.269529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=baf25ec0dbf04ddf86d1c26c1266d8b9) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:03.270036 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.271303 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 327/659] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:44:03.271945 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.279301 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 333/660] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:44:03 2022] GET /identity/v3/role_assignments?user.id=baf25ec0dbf04ddf86d1c26c1266d8b9&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=068868605675478a8abe0ef53a447f78 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:03.291312 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:03.404128 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da56287-117c-464b-be65-1afa88df6d2d None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.447363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.448461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.448946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.449430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] PATH_INFO: `/v3/services/image` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.450288 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.451990 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-63972728-fcbf-4fb2-b256-c33554734cd3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:03.467807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:03.468889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:03.469774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 328/661] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jul 25 21:44:03 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:03.475527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:03.528147 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:03.590335 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc528a-148f-4c71-9327-48de7aa3e0ab None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.624315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.625090 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.625373 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.625642 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.626351 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] RBAC: Adding query filter params (name=image) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:03.626653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.626757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0a23d-dd30-4265-a535-b444df715285 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.627018 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0a23d-dd30-4265-a535-b444df715285 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.627296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0a23d-dd30-4265-a535-b444df715285 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.628066 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.628757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 329/662] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:03.634711 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.635317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.635796 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.638200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 334/663] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:03.639204 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:03.655372 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:03.656917 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:03.674288 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:03.742953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 330/664] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:44:03.763424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:03.776997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7176d2e-52ec-4bfd-875f-edf3e49aebdd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.799907 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:03.826342 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.827383 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.827870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.828344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.829214 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] RBAC: Adding query filter params (type=image) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:03.829853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.831472 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.843418 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 335/665] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:03.878710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5697b-8025-469a-a0b9-de7c6f7dd490 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:03.919843 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:03.921751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:03.922062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:03.922328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] PATH_INFO: `/v3/services/network` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:03.922986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:03.924533 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:03.934590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:03.935690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:03.936562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 331/666] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:03 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:03.944011 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:04.058740 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9090d7-5720-4df9-97e3-9e9c43663f8a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:04.095217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:04.096163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:04.096668 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:04.097243 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:04.098112 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] RBAC: Adding query filter params (name=network) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:04.098616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:04.100204 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a67d1-7f74-4096-bdb1-1fb89da7998a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:04.105386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:04.115977 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:04.132248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:04.227095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee80de-8088-4da8-8099-0f63571b3c1e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:04.261914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:04.262528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:04.262807 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:04.263115 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:04.263786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] RBAC: Adding query filter params (type=network) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:04.264087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:04.265446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204171ca-98c6-495d-95af-bad59000eb11 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:04.270291 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:05.458790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3e0a2-429f-42c2-b84e-47d3a00cf0a2 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:05.459354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3e0a2-429f-42c2-b84e-47d3a00cf0a2 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:05.459354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3e0a2-429f-42c2-b84e-47d3a00cf0a2 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:05.474089 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 337/669] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:05.478136 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5004c7-d6f4-4d5e-8600-3c889242cb0e None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:05.478538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5004c7-d6f4-4d5e-8600-3c889242cb0e None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:05.478726 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5004c7-d6f4-4d5e-8600-3c889242cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:05.497666 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0d5004c7-d6f4-4d5e-8600-3c889242cb0e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:05.498837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0d5004c7-d6f4-4d5e-8600-3c889242cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:05.575046 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 333/670] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:44:05.592574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3e0a2-429f-42c2-b84e-47d3a00cf0a2 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:05.598112 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966b20-22a4-4609-bb2d-36609c42b81a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:05.598392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966b20-22a4-4609-bb2d-36609c42b81a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:05.598661 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4966b20-22a4-4609-bb2d-36609c42b81a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:05.600279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 334/671] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:05.608420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:05.608697 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:05.608966 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:05.622202 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:05.628817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:05.630091 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:05.642015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:05.715099 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 335/672] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:44:05.716190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3e0a2-429f-42c2-b84e-47d3a00cf0a2 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:05.735886 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:05.761995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:05.762643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:05.762962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:05.763244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:05.763953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:05.765876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:05.789461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 338/673] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:44:05 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:44:05.864568 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4252dc-7d4a-484d-a1b1-3547d020fa1f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:05.906235 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:05.911861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:05.912523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:05.912803 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:05.913074 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:05.925949 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:44:05.931218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:05.932269 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:05.933140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 336/674] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:05.938730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.051819 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:06.055185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f049ef2-5f3d-498c-a794-8554a541c9a2 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.092767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.093420 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.093711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.093985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.094702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:06.095032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.096495 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f0e0e-2257-41d8-92c5-14c4085bd310 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.106064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 339/675] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:06.111572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.175956 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad606a-9e2d-44b7-ada4-4e267b025454 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.176306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad606a-9e2d-44b7-ada4-4e267b025454 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.176486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad606a-9e2d-44b7-ada4-4e267b025454 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.179058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 340/676] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:06.188396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60743151-3b9e-483a-bf47-72858444a926 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.188396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60743151-3b9e-483a-bf47-72858444a926 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.188396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60743151-3b9e-483a-bf47-72858444a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.213285 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-60743151-3b9e-483a-bf47-72858444a926 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:06.214494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-60743151-3b9e-483a-bf47-72858444a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:06.219007 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21006ca8-e027-4e78-b076-7f7ca45b8cdd None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.255383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.256066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.256352 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.256624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.267249 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.268775 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:06.285260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:06.287328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:06.289433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:06.289433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:06.289433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:06.289433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:06.289433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 337/678] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:06.294960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 341/678] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:44:06.295155 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.311532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60743151-3b9e-483a-bf47-72858444a926 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.341999 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:06.400621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33395086-a5c0-4620-b7c5-55a84addbdad None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.411505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:06.421416 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60743151-3b9e-483a-bf47-72858444a926 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.436380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.437016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.437300 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.437578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.438290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:06.438593 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.440057 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.454328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 338/679] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:06.459861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.464335 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e9def-1d01-4b38-b3bf-a038693f2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.465714 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e9def-1d01-4b38-b3bf-a038693f2b83 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.466186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e9def-1d01-4b38-b3bf-a038693f2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.466636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e9def-1d01-4b38-b3bf-a038693f2b83 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.467598 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e9def-1d01-4b38-b3bf-a038693f2b83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.469208 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e9def-1d01-4b38-b3bf-a038693f2b83 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.499314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 342/680] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:44:06 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:44:06.585904 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae624-2e21-4ebb-a949-76ad00b3a1a8 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.588637 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:06.609853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b98a1-c693-440d-b63a-05bc5a479828 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.610211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b98a1-c693-440d-b63a-05bc5a479828 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.610408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b98a1-c693-440d-b63a-05bc5a479828 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.612056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 343/681] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:06.617516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.617789 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.618061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.631479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.632138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.632429 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.632685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.638818 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:06.640181 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:06.640715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.642177 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:44:06.654887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:06.656042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:06.657017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 339/682] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 21:44:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:06.662161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.735683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 344/683] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:06 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:44:06.759746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.789633 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217c2b2-882b-43ea-8339-1ad0a7481ebc None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.838009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.838868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.839347 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.839767 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.840724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:06.841603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.843579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.859477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:06.868029 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 340/684] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 21:44:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:06.879224 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f304-885c-4e5a-87e7-f3d14d4140af None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:06.879389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:06.899520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:06.924215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:06.925644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:06.926109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:06.926560 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:06.927464 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:06.929413 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:06.948771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 345/685] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:44:06 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:44:06.997416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609028a9-1c1a-475b-9eed-335795467912 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:07.049374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:07.050139 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:07.050417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:07.050681 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:07.063571 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:07.065046 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:07.082038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:07.083077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:07.084000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:07.084000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:07.084000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:07.084000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:07.084000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 341/686] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:07.090625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:07.201733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8bd37c-60de-40f0-be40-a641182e499e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:07.237174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:07.238169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:07.238654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:07.239158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:07.240049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:07.240570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:07.242153 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:07.255580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 346/687] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:07.261898 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:07.331146 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:07.367727 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fc49-f614-4489-9b0e-4ea0c448f81a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:07.403138 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:07.404112 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:07.404603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:07.405078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:07.412297 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:07.413959 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:44:07.425391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:07.426292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:07.427279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:07.429264 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 342/688] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:07.435081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:07.438127 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:07.543543 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c609-795a-4853-8993-e1db8347d678 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:07.578690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:07.579349 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:07.579628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:07.579901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:07.580646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:07.580947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:07.582377 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186ee54-0f2c-44a4-b6c8-f4e26f64ec49 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:07.595086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 347/689] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:07.600641 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:07.704994 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b15b9-2bed-4579-b8c5-91eae9637ae2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:07.731440 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:07.740399 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f923b-4555-4012-b365-990a85964b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:07.741085 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f923b-4555-4012-b365-990a85964b98 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:07.741365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f923b-4555-4012-b365-990a85964b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:07.741641 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f923b-4555-4012-b365-990a85964b98 None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/baf25ec0dbf04ddf86d1c26c1266d8b9/roles/068868605675478a8abe0ef53a447f78` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:07.744224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f923b-4555-4012-b365-990a85964b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=baf25ec0dbf04ddf86d1c26c1266d8b9, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:07.745696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f923b-4555-4012-b365-990a85964b98 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:07.761914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 343/690] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:44:07 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/baf25ec0dbf04ddf86d1c26c1266d8b9/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:44:08.219457 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c1bca-c291-4bdf-95f6-b9f1de3b9e8e None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.219792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c1bca-c291-4bdf-95f6-b9f1de3b9e8e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.220007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c1bca-c291-4bdf-95f6-b9f1de3b9e8e None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.221638 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 348/691] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:08.226823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.227136 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.227402 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.245580 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:08.246759 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:08.317163 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 344/692] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:08.341264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c1bca-c291-4bdf-95f6-b9f1de3b9e8e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:08.405081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:08.449712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c1bca-c291-4bdf-95f6-b9f1de3b9e8e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:08.484258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:08.484905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.485182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.485454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.486076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:08.487486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:08.499555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:08.500506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:08.501361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 349/693] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jul 25 21:44:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:08.506605 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:08.614465 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149625ec-3bfb-4654-988e-0de37d9ca7d2 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:08.632419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:08.652013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:08.652636 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.652917 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.653187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.653859 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:08.654162 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:08.655846 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:08.661417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 345/694] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 21:44:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:08.667023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:08.772200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8212574-2334-43d0-8933-19cc8a429ca5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:08.801568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:08.809900 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:08.810529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.810811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.811113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.811791 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:08.812097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:08.813482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b417d-4dbe-4574-80f9-dd2108769726 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:08.818650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 350/695] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 21:44:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:08.824466 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:08.912529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788ebe-5f68-4e5c-8e92-bcac876677f9 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.912963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788ebe-5f68-4e5c-8e92-bcac876677f9 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.913341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97788ebe-5f68-4e5c-8e92-bcac876677f9 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.915046 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 351/696] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:08.920860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.921249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.921624 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.927768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111bbd-9832-48c4-9757-2432ddcebd80 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:08.940443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:08.941784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:08.965043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:08.965658 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.965931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.966197 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.967102 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] RBAC: Adding query filter params (interface=public, service_id=6d90dd11e55b4db796aaa14f2b0d538b, region_id=RegionOne) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:08.967414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:08.968927 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:08.982368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 346/697] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:44:08 2022] GET /identity/v3/endpoints?service_id=6d90dd11e55b4db796aaa14f2b0d538b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:08.983736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.018995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 352/698] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:09.035603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:09.035869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.093898 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb5fb-e1ea-4a6d-b5a9-86cc622a25a5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.130881 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.131631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.131982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.132331 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.133053 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.135037 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.138995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c990b70-477c-4627-8249-7b7f2a3985bd None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.141088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 347/699] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:44:08 2022] GET /identity/v3/services => generated 1002 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:44:09.167353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:09.178820 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.179618 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.179968 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.180309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] PATH_INFO: `/v3/services/image` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.181120 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.182633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-228549ab-7543-4776-9d48-519c82607f13 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:09.193043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:09.195574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:09.198154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 353/700] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:09.206974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.316812 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cd887-cd65-4ef7-9f3a-8c70bfbf8e3f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.326358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:09.354676 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.355334 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.355610 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.355879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.356559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] RBAC: Adding query filter params (name=image) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:09.356929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.358298 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.364368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 348/701] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:09.364577 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c98b42-c479-4e7b-936a-6635894c0dbb None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.364858 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c98b42-c479-4e7b-936a-6635894c0dbb None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.365129 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c98b42-c479-4e7b-936a-6635894c0dbb None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.366548 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 354/702] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:09.370565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.375407 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.375955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.376424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.402771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:09.404558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:09.488276 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a4228-ef9a-45bb-a960-4e5ac2ff6fb4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.491427 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 355/703] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:09 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:09.521664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.537310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.538639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.539412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.539882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.541442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] RBAC: Adding query filter params (type=image) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:09.542222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.543804 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.555372 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 349/704] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:09.557170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.606318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:09.644142 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3299a53-dbed-4329-b1ee-b137094359d0 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.664123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:09.681355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89929-de2b-4580-bc77-bdf0a9aa0875 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.690807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.692188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.692929 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.693344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] PATH_INFO: `/v3/services/network` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.694422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.696249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:09.708385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:09.709699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:09.710728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:09.714080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 356/705] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:09.720770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.727101 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.727846 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.728187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.728549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.729365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] RBAC: Adding query filter params (interface=public, service_id=8d71443aad5e4d6f88328534108aec33, region_id=RegionOne) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:09.729737 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.731205 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.740896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 350/706] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/endpoints?service_id=8d71443aad5e4d6f88328534108aec33&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:09.742234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.847312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f08580-4ae9-4866-adb3-4abb2e28828e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.872343 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:09.876707 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6a97-85d9-4f12-93fe-d9cea998d356 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:09.895351 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.895970 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.896246 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.896516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.897483 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] RBAC: Adding query filter params (name=network) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:09.897784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.899713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.907058 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 357/707] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:09.912481 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:09.923446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:09.924576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:09.925227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:09.925792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:09.926681 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:09.928416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:09.942768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 351/708] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services => generated 1002 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:44:09.967560 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:10.036080 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a67ae-b971-4dfa-9448-df2cd848fde4 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:10.073159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:10.073808 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.074081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.074345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.075085 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] RBAC: Adding query filter params (type=network) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:10.075384 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:10.076823 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:10.087177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 358/709] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:10.089540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:10.202383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c30b3-d641-4589-8c60-816827a17efa None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:10.237022 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:10.237637 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.237914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.238181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.238947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] RBAC: Adding query filter params (interface=public, service_id=2b92b681d0cc4098a256ca969dee6e42, region_id=RegionOne) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:10.239257 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:10.240622 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12642127-b7dc-4f63-86dd-3a74217eb904 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:10.246831 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 352/710] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:44:10 2022] GET /identity/v3/endpoints?service_id=2b92b681d0cc4098a256ca969dee6e42&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:10.252438 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:10.252956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0396-292f-4e53-b67b-bf8e7930df71 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.253391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0396-292f-4e53-b67b-bf8e7930df71 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.253814 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0396-292f-4e53-b67b-bf8e7930df71 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.255618 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 353/711] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:10.261706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.262164 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.262621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.282042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:10.283717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:10.312715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:10.370957 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 354/712] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:10.385005 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac51c8-0416-476d-8e20-fcdc8c23ef9f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:10.390454 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:10.394158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:10.428816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:10.429443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.429719 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.429992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.430642 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:10.432758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:10.438328 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 359/713] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:44:10 2022] GET /identity/v3/services => generated 1002 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:44:10.512740 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530242-59be-46ae-b2c7-351bf9f71154 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:10.552015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:10.552677 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.552956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.553228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.565406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:44:10.570487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:10.572109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:10.572980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 355/714] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:10.580707 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:10.688226 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d08b88-419b-4353-9079-602bc4a30134 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:10.721840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:10.722482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.722721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.723018 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.723724 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:10.724076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:10.725431 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:10.733975 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 360/715] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:10.739680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:10.761711 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:10.850912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97528119-28e1-4dc3-8d41-0e2a32427123 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:10.887638 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:10.888275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:10.888553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:10.888826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:10.899252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:10.901247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:10.917009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:10.917944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:10.918982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:10.918982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:10.918982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:10.918982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:10.918982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 356/716] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:10.925310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:10.973236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:11.033626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfbbe-fbe4-4963-9590-9e2bf7ff6f56 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.068000 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:11.068617 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.068889 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.069160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.069841 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:11.070140 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:11.072142 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:11.084383 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 361/717] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:11.090058 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.166023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:11.201263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16907c-1cdd-4665-8493-a7ea2f5c384e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.241917 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:11.242567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.242848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.243151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.251666 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:11.253147 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:44:11.266480 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:11.267585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:11.268561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 357/718] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:11.275667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.376257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:11.385294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc427671-5632-4471-8829-e38b9df38dd3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.420070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:11.420686 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.420957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.421223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.422007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:11.422303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:11.423746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7844f-7113-4098-9cd6-2878b3259a11 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:11.441094 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 362/719] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:11.447361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.474250 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f1f0-2c73-4453-ae7e-d82eb25ac0da None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.474536 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f1f0-2c73-4453-ae7e-d82eb25ac0da None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.474969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6f1f0-2c73-4453-ae7e-d82eb25ac0da None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.476266 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 363/720] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:11.482210 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.482488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.482755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.501646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:11.502811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:11.574167 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 364/721] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:11.576943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbe627-92b0-4772-bf69-9099b427574a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.594209 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.609071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:11.616157 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:11.617055 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.617576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.618095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.683878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:11.698119 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:11.700081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:11.704635 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715996c6-6115-41d3-9862-d8771e689c06 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.741954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:11.742593 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.742867 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.743152 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.744145 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:11.745298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:11.754772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:11.755771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:44:11.756632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:11.761398 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 365/722] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:11.761957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.813603 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 358/723] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:44:11.822365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.858465 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:11.879884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e67e9e-996a-429f-9b96-cc3b5a3065cc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.923736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:11.924527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:11.924809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:11.925130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:11.925841 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:11.926264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:11.928284 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:11.938529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 366/724] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:11.940052 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:11.953899 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220867aa-e987-42d3-afed-6f82a3e425f2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:11.954798 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.002888 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.003838 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.004263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.004678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.015822 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.017526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:12.033471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:12.034842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:12.036059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:12.036059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:12.036059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:12.036059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:12.037851 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 359/725] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:12.047150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.077345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908999-09fe-4924-905c-261dbb996634 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.112318 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.112949 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.113668 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.113831 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.114506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:12.114854 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.116521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.129040 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 367/726] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Jul 25 21:44:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:12.130141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.147283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.169828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1fd30-6aca-455d-8d04-9b88f347ce77 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.206829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.207844 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.208322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.208878 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.209513 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.211571 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:12.212714 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.214333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.228719 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 360/727] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:12.241493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.254612 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991442cb-91e2-4eb5-8a29-e6564a44f3db None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.308147 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35954873-eea0-4aad-89a9-c1e035aabd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.308835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954873-eea0-4aad-89a9-c1e035aabd00 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.309124 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954873-eea0-4aad-89a9-c1e035aabd00 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.309397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35954873-eea0-4aad-89a9-c1e035aabd00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.310108 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954873-eea0-4aad-89a9-c1e035aabd00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.311521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35954873-eea0-4aad-89a9-c1e035aabd00 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.347028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 368/728] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:44:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:44:12.385766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8719e-4b90-45e4-bc16-5e13abc14042 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.425296 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a7789-d1cd-4485-b6e7-adade77b2d66 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.425607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a7789-d1cd-4485-b6e7-adade77b2d66 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.425955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a7789-d1cd-4485-b6e7-adade77b2d66 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.431611 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 369/729] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:12.433466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.433749 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.434019 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.442792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.443558 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.443845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.444120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.452095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.453577 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.455226 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:12.455698 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.456432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:44:12.471289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:12.472227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:12.473135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 361/730] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:12.478682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.579031 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 370/731] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:12.598192 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.629806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8961-03b4-4bba-a49e-bfc8ddcf114e None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.672680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.673803 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.674441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.674716 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.675111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.675890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:12.676191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.677940 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.695741 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 362/732] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:12.704441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.722543 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bf86-94d9-4815-bde7-18d392cba6b3 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.760103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.760739 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.761019 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.761289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.761915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.763422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.769266 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:12.774500 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:12.775633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:44:12.776504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:12.782237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 371/733] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:12.782237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:12.816829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80962c89-fd59-4c3c-9506-1804739f1b4b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.854271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.854885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.855310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.855581 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.856355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=baf25ec0dbf04ddf86d1c26c1266d8b9) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:12.856657 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.858210 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30995-eb22-442c-9930-0375f5fcf3b4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.864183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 363/734] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/role_assignments?user.id=baf25ec0dbf04ddf86d1c26c1266d8b9&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=068868605675478a8abe0ef53a447f78 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:12.865408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199738d-379d-4f77-b66a-142e64ff2e0a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.865686 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199738d-379d-4f77-b66a-142e64ff2e0a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.865959 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199738d-379d-4f77-b66a-142e64ff2e0a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.867578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 364/735] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:12.877451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.877738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.878154 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.895050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bac513-5cad-481f-99e1-d4a9d91f13c0 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:12.899471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:12.900912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:12.921773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:12.935756 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:12.936788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:12.937243 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:12.937704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:12.938589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] RBAC: Adding query filter params (name=image) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:12.939126 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:12.940725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:12.951729 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 372/736] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:12.953585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:13.003364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 365/737] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:13.030490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:13.090027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:13.097443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b5a8-a652-4c18-b6a5-ae32f0859b30 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:13.145545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:13.146169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:13.146444 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:13.146713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:13.147424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] RBAC: Adding query filter params (type=image) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:13.147731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:13.148180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2f46-6239-4934-9c1f-4bb32162d550 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:13.149104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:13.156703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 373/738] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:13.162412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:13.189017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:13.189967 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:13.190527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:13.191008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] PATH_INFO: `/v3/services/network` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:13.191834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:13.193508 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:13.203974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:13.204998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:44:13.205877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:13.208850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 366/739] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:13 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:13.215618 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:13.223671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:13.294883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2272c86-423d-40a9-9505-e8db96990bf6 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:13.330445 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334d425-8857-41ac-a1e5-d4fa80d8e223 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:13.340372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:13.341482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:13.341825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:13.342367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:13.343188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:13.345311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:13.347538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:13.373653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 374/740] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:44:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:44:13.374687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:13.382952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:13.382952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:13.382952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:13.382952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] RBAC: Adding query filter params (name=network) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:13.382952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:13.382952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:13.397339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 367/741] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:13.403167 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:13.545238 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814cfb2-5cb3-4687-bb11-db1ae0c60cda None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:13.547269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:13.582826 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:13.583477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:13.583755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:13.584024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:13.584689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] RBAC: Adding query filter params (type=network) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:13.584988 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:13.586428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f8b8-e2be-4e5a-9ffb-e0dc5121ae6f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:13.594604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 375/742] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:13.597475 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:13.712905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2f364-6ec4-47cd-871b-1d02873cc720 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:13.748429 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d6f80-b487-4f69-bce0-d2ddeb1e83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:13.749043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6f80-b487-4f69-bce0-d2ddeb1e83e3 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:13.749317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6f80-b487-4f69-bce0-d2ddeb1e83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:13.749587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d6f80-b487-4f69-bce0-d2ddeb1e83e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:13.750293 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d6f80-b487-4f69-bce0-d2ddeb1e83e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:13.751687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d6f80-b487-4f69-bce0-d2ddeb1e83e3 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:13.774207 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 368/743] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:44:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:44:14.777214 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554358ab-e321-404f-a243-46ca24c8a87e None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:14.777731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554358ab-e321-404f-a243-46ca24c8a87e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:14.777731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554358ab-e321-404f-a243-46ca24c8a87e None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:14.780025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 376/744] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:14.784240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:14.784956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:14.785040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:14.803803 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:14.805002 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:14.839451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:14.885387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 369/745] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:14 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:14.908684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554358ab-e321-404f-a243-46ca24c8a87e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.019346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554358ab-e321-404f-a243-46ca24c8a87e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.056882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.057445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.057725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.058020 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.058613 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:15.060026 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:15.068836 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:15.069827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:15.070720 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:15.075085 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 377/746] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:15.076539 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.182552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95877fae-2356-4e30-b7cb-6a52eb05b12a None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.217203 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.217819 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.218096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.218366 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.219063 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:15.219394 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:15.220749 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1694d6-b281-4cde-af2b-fe6cdf8f2815 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:15.229834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 370/747] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:15.231127 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.249133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d3f33-07dd-458b-ba83-e45e424afafb None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.249429 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d3f33-07dd-458b-ba83-e45e424afafb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.249946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d3f33-07dd-458b-ba83-e45e424afafb None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.252373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 371/748] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:15.260853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.260853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.260853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.265569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:15.282790 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:15.284373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:15.305409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:15.352812 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773cdf1-ccd3-472a-ac9f-929bbb2b5f02 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.359765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 372/749] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:15 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:15.377714 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.392001 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.392621 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.392898 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.393171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.393838 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:15.394141 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:15.395537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:15.410963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 378/750] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:15.492328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc17c6b-b444-4e96-8d1c-ed03408f5f41 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.533022 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.533863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.534154 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.534498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.535544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:15.537064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-b9ba0b98-4fcf-4c3a-a219-854f75a66dcc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:15.547272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:15.548523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:15.549589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:15.551116 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 373/751] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jul 25 21:44:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:15.557452 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.659302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:15.668347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a49c5e-b86e-463b-899d-21a8defd3d7a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.683319 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015553e-7913-42b5-9f73-b96abe0f28f0 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.684060 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015553e-7913-42b5-9f73-b96abe0f28f0 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.684335 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015553e-7913-42b5-9f73-b96abe0f28f0 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.685678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 374/752] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:15.692553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.692834 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.693096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.704053 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.704681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.704961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.705234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.705906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:15.706202 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:15.707598 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:15.711778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:15.712331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 379/753] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 21:44:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:15.713049 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:15.717705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.727479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:15.784621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 375/754] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:15 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:15.808376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:15.825790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f2c00-d37e-4c15-8e92-7746897a3baa None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.863075 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.863985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.864269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.864544 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.865233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:15.865537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:15.867528 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:15.872400 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 380/755] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 21:44:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:15.919955 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef6604-83a1-4d7d-9672-e5204ec703a1 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:15.957027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:15.957657 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:15.957981 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:15.958294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:15.979526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:16.035351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:16.036825 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:16.140918 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 376/756] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:44:15 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 21:44:16.146527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:16.172847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:16.248358 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061f825-091a-4ee9-9fcf-c44e34719dd2 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:16.285521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:16.286152 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:16.286426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:16.286693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:16.297066 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:16.298507 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-b27c55a6-64bb-4a45-bbaf-0e73004766fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:44:16.312673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:16.313619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:16.314537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:44:16.314537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:44:16.314537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:44:16.314537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:16.318620 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 381/757] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:16.320035 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:16.370668 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:16.420731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ee7d-a4b7-4f0c-b124-7eb932884c86 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:16.453676 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:16.454286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:16.454560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:16.454825 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:16.455531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:16.455828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:16.457168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ccdb-3f08-42df-bfe6-4e3ef75f9048 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:16.471471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 377/758] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:17.628332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e346c6-5aca-415e-b765-ebdc4533952f None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:17.628891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e346c6-5aca-415e-b765-ebdc4533952f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:17.628891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e346c6-5aca-415e-b765-ebdc4533952f None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:17.630197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 382/759] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:17.635614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70dfaf-e5cc-40f1-8917-a4b3f154f7fc None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:17.636039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70dfaf-e5cc-40f1-8917-a4b3f154f7fc None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:17.636287 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70dfaf-e5cc-40f1-8917-a4b3f154f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:17.654425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-eb70dfaf-e5cc-40f1-8917-a4b3f154f7fc None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:17.655649 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-eb70dfaf-e5cc-40f1-8917-a4b3f154f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:17.719515 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 378/760] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:17 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:17.743178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e346c6-5aca-415e-b765-ebdc4533952f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:17.817150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:17.842565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e346c6-5aca-415e-b765-ebdc4533952f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:17.874856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d1c58-17dc-4679-9098-458df88f1029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:17.875618 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d1c58-17dc-4679-9098-458df88f1029 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:17.875892 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d1c58-17dc-4679-9098-458df88f1029 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:17.876162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d1c58-17dc-4679-9098-458df88f1029 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:17.876847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d1c58-17dc-4679-9098-458df88f1029 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:17.878217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d1c58-17dc-4679-9098-458df88f1029 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:17.892496 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 383/761] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:44:17 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:44:18.130895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0527464-e01e-4793-ad2d-21e62a6b9bd0 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:18.131151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0527464-e01e-4793-ad2d-21e62a6b9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:18.131405 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0527464-e01e-4793-ad2d-21e62a6b9bd0 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:18.132875 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 379/762] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:18.138391 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363689-240e-430b-b05b-585d8edec6c9 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:18.138677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363689-240e-430b-b05b-585d8edec6c9 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:18.138980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363689-240e-430b-b05b-585d8edec6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:18.157972 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-79363689-240e-430b-b05b-585d8edec6c9 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:18.159177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-79363689-240e-430b-b05b-585d8edec6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:18.228992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 384/763] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:18 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:18.252755 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0527464-e01e-4793-ad2d-21e62a6b9bd0 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:18.298382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:18.357877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0527464-e01e-4793-ad2d-21e62a6b9bd0 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:18.391794 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1558d-cfc1-4223-b6ae-fef61de70066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:18.392340 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1558d-cfc1-4223-b6ae-fef61de70066 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:18.392627 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1558d-cfc1-4223-b6ae-fef61de70066 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:18.392901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1558d-cfc1-4223-b6ae-fef61de70066 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:18.393601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1558d-cfc1-4223-b6ae-fef61de70066 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:18.395024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1558d-cfc1-4223-b6ae-fef61de70066 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:18.413201 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 380/764] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:44:18 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:44:20.126403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681acc2-d741-4ba3-b215-ef6f0b0206a6 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.127004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681acc2-d741-4ba3-b215-ef6f0b0206a6 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.127004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681acc2-d741-4ba3-b215-ef6f0b0206a6 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.128315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 385/765] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:20.133503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.133942 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.134064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.151585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:20.152756 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:20.224433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 381/766] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:20.247972 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681acc2-d741-4ba3-b215-ef6f0b0206a6 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.313524 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:20.355837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681acc2-d741-4ba3-b215-ef6f0b0206a6 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:20.388656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:20.389226 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.389504 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.389777 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.390397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:20.391800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:20.400948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:20.401966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:20.403050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 386/767] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:20.408465 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.434066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:20.509786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c045-7710-42b8-a9e8-33244983d0bd None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:20.543983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:20.544591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.544862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.545124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.545783 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:20.546078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:20.547471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2af3a-ca38-4fae-a663-ced78befdc76 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:20.551958 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:20.558202 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.650233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112e62-40d8-474d-bdcd-a787f1b67cc8 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.650434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112e62-40d8-474d-bdcd-a787f1b67cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.650682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112e62-40d8-474d-bdcd-a787f1b67cc8 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.652035 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 383/769] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:20.655290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1dbbe-2164-46b7-88ea-0c2becd8f184 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:20.656970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.657242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.657512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.675164 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:20.676345 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:20.679050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:20.690092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:20.690701 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.691006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.691272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.691960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:20.692257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:20.693608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:20.698843 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 387/770] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:20.704482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.751534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 384/771] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:20.775609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.795898 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:20.805585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf514c6-3359-48cb-bbf7-d57998ba5b26 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:20.838691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:20.839323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.839607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.839879 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.840804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] RBAC: Adding query filter params (interface=public, service_id=fc07606dda444274b0956f9ce7f21a1b, region_id=RegionOne) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:20.841118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:20.842508 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:20.849601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 388/772] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/endpoints?service_id=fc07606dda444274b0956f9ce7f21a1b&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:20.855679 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.877456 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa514e-debc-4eb6-87be-f1e919a7a58f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:20.906637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:20.910895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:20.911577 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.911851 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.912117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.912730 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:20.914075 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:20.923228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:20.924387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:20.925453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 385/773] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:20.930153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:20.957673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc4b5b-c3e3-4e60-a68b-7ad53b356a95 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:20.989750 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:20.990346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:20.990625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:20.990895 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:20.991554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:20.992897 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:20.998543 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 389/774] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:44:21.013806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:21.037192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e37db-e88d-4e9d-b018-0114040f0115 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:21.082311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:21.082970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:21.083254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:21.083529 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:21.084220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:21.084524 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:21.085924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:21.091614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 386/775] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 21:44:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:21.097554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:21.205643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387471f-3816-446e-8afd-78ef5c650a20 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:21.221933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:21.240030 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:21.240646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:21.240922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:21.241191 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:21.241860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:21.242160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:21.243591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:21.248211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 390/776] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 21:44:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:21.254124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:21.354024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b922df1-c2c1-41be-8d4e-e4078d8097d7 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:21.391323 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:21.391947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:21.392226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:21.392497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:21.393245 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] RBAC: Adding query filter params (interface=public, service_id=e3fdd64a3bc44d418d57bae7eec889d2, region_id=RegionOne) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:21.393553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:21.394911 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66c0d2-de01-4a19-a3d8-fb5f4ea627ac None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:21.400475 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 387/777] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:44:21 2022] GET /identity/v3/endpoints?service_id=e3fdd64a3bc44d418d57bae7eec889d2&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:21.405982 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:21.507422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9f55b-bfff-422c-9da0-a22bd1cc9848 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:21.539959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd282d3-f674-4614-bf37-5cb1b8bc77f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:21.541143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd282d3-f674-4614-bf37-5cb1b8bc77f3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:21.541459 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd282d3-f674-4614-bf37-5cb1b8bc77f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:21.541730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd282d3-f674-4614-bf37-5cb1b8bc77f3 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:21.542462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd282d3-f674-4614-bf37-5cb1b8bc77f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:21.543885 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd282d3-f674-4614-bf37-5cb1b8bc77f3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:21.549795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 391/778] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:44:21 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:44:23.222547 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301676b-d81b-42b8-92c1-6a9dddb4f177 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.223111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301676b-d81b-42b8-92c1-6a9dddb4f177 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.223111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301676b-d81b-42b8-92c1-6a9dddb4f177 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.224454 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 388/779] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:23.230313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.230725 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.230941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.249065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:23.250233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:23.288974 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:23.321614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 392/780] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:23.345092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301676b-d81b-42b8-92c1-6a9dddb4f177 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:23.360396 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:23.447784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301676b-d81b-42b8-92c1-6a9dddb4f177 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:23.483071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:23.483710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.483985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.484253 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.484877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:23.486251 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:23.494818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:23.495936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:23.496890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 389/781] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:23.502024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:23.599654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d653f7-d9a4-4375-a63d-a9b474722b05 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:23.635403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:23.636014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.636317 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.636583 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.637247 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:23.637542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:23.638888 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bda473-cdd5-4936-8e2f-c452dd12ae15 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:23.643498 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 393/782] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:23.649229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:23.726970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:23.749204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b793-d28a-434c-a0b3-93839d2b20d7 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:23.768387 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497db32-bb15-40b4-9487-0561e311056f None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.768666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497db32-bb15-40b4-9487-0561e311056f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.768942 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497db32-bb15-40b4-9487-0561e311056f None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.770260 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 394/783] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:23.775559 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.775840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.776115 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.785523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:23.786142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.786421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.786693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.787413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:23.787716 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:23.789069 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:23.794325 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:23.794451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 390/784] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Jul 25 21:44:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:23.795541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:23.800026 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:23.824596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:23.861254 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 395/785] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:23.884786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:23.897756 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccc2f5-e121-4dfb-b048-dc24d616854f None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:23.931169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:23.931787 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:23.932063 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:23.932332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:23.933029 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:23.934385 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:23.943245 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:23.955777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 391/786] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:44:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:44:23.983132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6509287-7d25-49a6-beb6-782d2e5208ef None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:24.024838 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:24.025494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:24.025772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:24.026043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:24.026682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:24.028123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:24.037837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:24.038933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:24.039809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 396/787] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Jul 25 21:44:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:44:24.045759 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:24.155670 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a3e1c-a3cc-471a-b29f-6a29ca9e07da None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:24.189798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:24.190419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:24.190696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:24.191027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:24.191697 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:24.191997 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:24.193347 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:24.197870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 392/788] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 21:44:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:24.203763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:24.232333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:24.301230 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d30ce8-6d9d-40dc-8542-a9dd92c16ebd None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:24.334049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:24.334664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:24.334964 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:24.335238 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:24.335905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:24.336200 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:24.338055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4c3d3-f579-4119-afe2-63a527594ef4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:24.342656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 397/789] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Jul 25 21:44:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:24.348375 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:24.405976 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:24.448066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a10913-06e0-4fca-91e3-0d01e6ec6311 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:24.483206 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5bf61-6321-4e14-85ad-49dfcbee0d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:24.483891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5bf61-6321-4e14-85ad-49dfcbee0d0b None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:24.484169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5bf61-6321-4e14-85ad-49dfcbee0d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:24.484438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5bf61-6321-4e14-85ad-49dfcbee0d0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:24.485134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5bf61-6321-4e14-85ad-49dfcbee0d0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:24.486489 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5bf61-6321-4e14-85ad-49dfcbee0d0b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:24.507201 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 393/790] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:44:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:44:26.194618 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef240-9f88-4f30-8df7-51e7f7f65050 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.195244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef240-9f88-4f30-8df7-51e7f7f65050 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.195244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bef240-9f88-4f30-8df7-51e7f7f65050 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.197095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 398/791] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:26.202394 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.202825 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.202952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.221000 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:26.222171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:26.291930 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 394/792] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:26.316263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef240-9f88-4f30-8df7-51e7f7f65050 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:26.406211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:26.416885 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bef240-9f88-4f30-8df7-51e7f7f65050 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:26.449087 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:26.449633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.449911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.450181 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.450840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:26.452314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:26.454873 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING keystone.server.flask.common [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 21:44:26.473268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.sql.core [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:44:26.473268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 21:44:26.473268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [parameters: {'id': '949bf0b0da6843d38fb49f7f0d4f25d7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 21:44:26.473268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87159) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 949bf0b0da6843d38fb49f7f0d4f25d7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 949bf0b0da6843d38fb49f7f0d4f25d7. Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:44:26.489155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application result.read() Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 21:44:26.490189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application yield resource Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise self.value Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application session.commit() Jul 25 21:44:26.491429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:44:26.492486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:44:26.493992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application result.read() Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:44:26.494896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [parameters: {'id': '949bf0b0da6843d38fb49f7f0d4f25d7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:26.495846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:26.498778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 949bf0b0da6843d38fb49f7f0d4f25d7. Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:26.500253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 399/793] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Jul 25 21:44:26 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:26.500964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:26.542671 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:26.601761 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e702a0-39da-4eef-8ae3-926e561f5f65 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:26.637808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:26.638441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.638716 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.639025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.645506 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:26.646973 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-2b03eecc-3519-4696-9bef-84e7d2371359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:44:26.658527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:26.660986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:44:26.663113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:26.664629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 395/794] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:26.666822 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:26.752035 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756843-04ad-4192-84e4-f244c1a75543 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.752250 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756843-04ad-4192-84e4-f244c1a75543 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.752527 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756843-04ad-4192-84e4-f244c1a75543 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.753863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 396/795] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:26.758563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.758875 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.759182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.765017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3723df5-af38-41ae-abef-65eb07f7e9e4 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:26.777081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:26.778258 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:26.800646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:26.801252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:26.801523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:26.801792 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:26.802532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:26.802827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:26.804506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:26.824132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 400/796] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:26.846169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 397/797] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:26.869787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:26.882403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:26.976975 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7d731-cfe0-4a79-944c-204c88ae4e5c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:27.012794 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:27.013377 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:27.013655 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:27.013925 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] PATH_INFO: `/v3/services/compute` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:27.014549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:27.016000 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:27.025345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:27.026584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:27.027547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 401/798] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:27.032604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:27.063192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:27.130777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2891-4b37-4010-85dc-73ed7141f93b None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:27.165244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:27.165858 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:27.166130 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:27.166398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:27.167093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:27.167390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:27.168735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b521b-8953-4b66-ad8d-afd6df3b9f65 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:27.173268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 398/799] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:27.178876 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:27.247696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:27.277688 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5105d-a819-4767-9371-e2e3d2f8052f None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:27.310315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:27.310961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:27.311236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:27.311511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:27.312178 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:27.312477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:27.313846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96b1b-8880-4a7b-ae0e-97db4e159b21 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:27.327050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 402/800] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:29.131665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87ba7f-fb6d-466d-9aa5-1b879b8af125 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.132203 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87ba7f-fb6d-466d-9aa5-1b879b8af125 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.132203 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87ba7f-fb6d-466d-9aa5-1b879b8af125 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.133525 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 399/801] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:29.139417 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.139822 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.139964 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.158553 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:29.160349 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:29.227409 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 403/802] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:29.252543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87ba7f-fb6d-466d-9aa5-1b879b8af125 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:29.345391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:29.352751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87ba7f-fb6d-466d-9aa5-1b879b8af125 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:29.390362 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:29.390897 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.391189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.391455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.392130 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:29.393551 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:29.396180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING keystone.server.flask.common [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 21:44:29.408780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.sql.core [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:44:29.408780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 21:44:29.408780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [parameters: {'user_id': 'e9f2453afe27463aacf1c822c8802ba1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 21:44:29.408780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87160) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-ec8b5915-b8b0-4240-b249-c1c1d89543af None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application result.read() Jul 25 21:44:29.424509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:44:29.425585 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application yield resource Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise self.value Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application session.commit() Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:44:29.426601 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:44:29.427552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:44:29.428498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application result.read() Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:44:29.429364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e9f2453afe27463aacf1c822c8802ba1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:29.430214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 21:44:29.431042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:29.432011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 400/803] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Jul 25 21:44:29 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:29.432434 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:29.498641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:29.519586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a2aa-2d45-4934-a560-8d819a3ad4df None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.519863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a2aa-2d45-4934-a560-8d819a3ad4df None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.520133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374a2aa-2d45-4934-a560-8d819a3ad4df None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.524342 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 401/804] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:44:29.529174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.529452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.529721 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.532252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8404ab-926a-4884-88ac-970acb11069b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:29.547945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:29.549426 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:29.565933 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:29.566570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.566842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.567138 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.574497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:29.575967 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:44:29.587199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:29.588322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:29.589313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 404/805] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:44:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:29.594342 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:29.614504 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 402/806] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:44:29.638484 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:29.692510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054ebea-9874-4f27-9c97-d8c02957e5f5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:29.717266 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:29.725821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:29.725991 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:29.726428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.726790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.727032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.727936 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:29.728191 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:29.729614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8155d0-8d11-4590-aacc-7055ed12e19c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:29.739025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816d3ec-4780-4425-b306-9fe6055de5e5 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:29.764456 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 405/807] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Jul 25 21:44:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:29.773230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab15720-3ee4-462b-bed7-e2ec710e5fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:29.773874 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15720-3ee4-462b-bed7-e2ec710e5fa8 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:29.774153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15720-3ee4-462b-bed7-e2ec710e5fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:29.774494 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15720-3ee4-462b-bed7-e2ec710e5fa8 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:29.775241 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab15720-3ee4-462b-bed7-e2ec710e5fa8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:29.776816 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab15720-3ee4-462b-bed7-e2ec710e5fa8 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:29.803108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 403/808] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:44:29 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:44:32.007662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d36446-d7d1-4825-8f56-59ee0bdd11f3 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.008211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d36446-d7d1-4825-8f56-59ee0bdd11f3 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.008211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d36446-d7d1-4825-8f56-59ee0bdd11f3 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.010121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 406/809] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:32.015141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.015510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.015684 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.033076 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:32.034230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:32.102217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 404/810] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:32 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:32.126057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d36446-d7d1-4825-8f56-59ee0bdd11f3 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:32.223313 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d36446-d7d1-4825-8f56-59ee0bdd11f3 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:32.254943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:32.255568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.255840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.256106 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.256717 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:32.258125 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:32.267034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:32.268187 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:44:32.269212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 407/811] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:32.273843 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:32.344406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:32.370235 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a786ab-fa44-49d3-bd94-82f8e14ca960 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:32.403680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:32.404286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.404560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.404828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.405497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:32.405797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:32.407180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:32.412135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 405/812] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:32.417855 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:32.465072 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:32.515685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3d776-54d8-4e54-abaf-d2c2c8282681 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:32.547461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:32.548073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.548353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.548623 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.549323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] RBAC: Adding query filter params (type=compute) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:32.549627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:32.551026 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:32.556289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 408/813] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:32.562223 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:32.657903 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03babcc1-ad96-4701-86b4-97b81c35214c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:32.690726 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:32.691363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.691642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.691913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.692656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] RBAC: Adding query filter params (interface=public, service_id=87952b9dfbe14805852121a9ee30e440, region_id=RegionOne) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:32.692963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:32.694314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36828b3b-b3ee-4ee8-b439-1333efb5d7d8 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:32.699839 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 406/814] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:44:32 2022] GET /identity/v3/endpoints?service_id=87952b9dfbe14805852121a9ee30e440&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:32.705241 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:32.802191 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ed297-dde3-40c7-b2f2-b5ec8f47e30a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:32.814815 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:32.835684 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c068b19-a7ee-4dce-aadc-cc78d3437941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:32.836291 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068b19-a7ee-4dce-aadc-cc78d3437941 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:32.836573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068b19-a7ee-4dce-aadc-cc78d3437941 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:32.836893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c068b19-a7ee-4dce-aadc-cc78d3437941 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:32.837539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c068b19-a7ee-4dce-aadc-cc78d3437941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:32.838909 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c068b19-a7ee-4dce-aadc-cc78d3437941 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:32.844919 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 409/815] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:44:32 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:44:35.033820 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2964bb-bc2b-43a9-bfb2-3946653c34ad None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:35.034382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2964bb-bc2b-43a9-bfb2-3946653c34ad None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:35.034382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2964bb-bc2b-43a9-bfb2-3946653c34ad None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:35.035981 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 407/816] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:35.041061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:35.041473 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:35.041647 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:35.061265 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:35.062475 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:35.132742 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 410/817] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:44:35 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:44:35.156353 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2964bb-bc2b-43a9-bfb2-3946653c34ad None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:35.159279 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:35.257575 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2964bb-bc2b-43a9-bfb2-3946653c34ad None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:35.290491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:35.291104 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:35.291380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:35.291646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:35.292252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:35.293680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:44:35.302134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:44:35.303315 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:44:35.304199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 408/818] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:44:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:44:35.309865 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:35.404355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab648-4d92-4f81-8928-36a003abf672 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:35.411799 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:35.438661 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:35.439358 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:35.439636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:35.439930 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:35.440592 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:35.440890 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:35.442237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:35.446831 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 411/819] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:44:35.452632 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:35.516006 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:35.550992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff58777-961f-451e-af2d-752e769d97f3 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:35.582481 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:35.583117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:35.583398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:35.583670 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:35.584342 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:44:35.584645 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:35.586001 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890d51f-e085-416f-9093-c8cf7717fb03 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:35.591137 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 409/820] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Jul 25 21:44:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:44:35.596810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:35.692722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5565-c91c-4b9c-8c97-6566975d2506 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:35.724696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55894e7-b7e3-46c2-bcd2-987aec949de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:35.725293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55894e7-b7e3-46c2-bcd2-987aec949de9 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:35.725566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55894e7-b7e3-46c2-bcd2-987aec949de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:35.725833 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55894e7-b7e3-46c2-bcd2-987aec949de9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:35.726531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55894e7-b7e3-46c2-bcd2-987aec949de9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:35.728527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55894e7-b7e3-46c2-bcd2-987aec949de9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:35.747151 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 412/821] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:44:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:44:45.588743 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=35 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:45.743070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:36.761456 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a29f-abe7-40bf-b41e-f438956492a4 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:36.762047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a29f-abe7-40bf-b41e-f438956492a4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:36.762047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a29f-abe7-40bf-b41e-f438956492a4 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:36.763497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 410/822] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:45:36.769059 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:36.769551 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:36.769733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:36.789939 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:36.791454 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:36.886219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 413/823] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:45:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:45:36.913630 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9a29f-abe7-40bf-b41e-f438956492a4 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:37.047223 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9a29f-abe7-40bf-b41e-f438956492a4 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:37.088214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:37.088869 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:37.089142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:37.089398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:37.100683 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:37.102158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:37.118254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:37.123412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:37.124609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:37.124609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:37.124609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:37.124609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:37.124609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 411/824] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:37.128515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:37.256634 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11741-82ac-43f3-89c4-741575c36634 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:37.288073 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:37.298626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:37.299233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:37.299512 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:37.299786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:37.300481 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:37.300782 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:37.302169 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df9ec-5acb-4e87-8314-80af67bcd853 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:37.314679 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 414/825] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:37.322496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:37.394208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:37.453738 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bb8f6-84d7-44bd-b8d8-03a7d777b993 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:37.499015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264c282-7e77-4021-ae3f-c3b5af4c893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:37.499700 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264c282-7e77-4021-ae3f-c3b5af4c893f None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:37.500031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264c282-7e77-4021-ae3f-c3b5af4c893f None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:37.500339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264c282-7e77-4021-ae3f-c3b5af4c893f None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:37.501111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264c282-7e77-4021-ae3f-c3b5af4c893f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:37.502751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264c282-7e77-4021-ae3f-c3b5af4c893f None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:37.531390 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 412/826] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Jul 25 21:45:37 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:45:39.965949 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499186ac-3036-44bd-a826-1eb1a31b2600 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:39.967351 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499186ac-3036-44bd-a826-1eb1a31b2600 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:39.967351 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499186ac-3036-44bd-a826-1eb1a31b2600 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:39.968078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 415/827] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:45:39.973309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:39.973818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:39.973914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:39.993654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:39.994819 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:40.072007 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 413/828] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:45:39 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:45:40.098210 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499186ac-3036-44bd-a826-1eb1a31b2600 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:40.218295 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499186ac-3036-44bd-a826-1eb1a31b2600 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:40.254622 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:40.255344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:40.255663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:40.255941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:40.267315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:45:40.272215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:40.273306 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:40.274772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 416/829] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:45:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:40.280043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:40.322518 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:40.390578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8c7e7-cb9e-4fba-8b4c-9b18c9809cb3 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:40.425691 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:40.426404 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:40.426703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:40.427049 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:40.427808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:40.428111 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:40.429647 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:40.438646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 414/830] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:45:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:40.444616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:40.498552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:40.563681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e404d-0875-4b4c-b860-c181e88f1356 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:40.596730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:40.597374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:40.597656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:40.597929 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:40.611822 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:40.613282 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:40.627626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:40.628687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:40.629787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:40.629787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:40.629787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:40.629787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:40.629787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 417/831] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:45:40.636693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:40.751641 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:40.755772 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437f913-954f-4930-84fd-3d42fcde3aa2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:40.799896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:40.800961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:40.801476 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:40.803360 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:40.803360 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:40.803639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:40.806094 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:40.823226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 415/832] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:40.828999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:40.948911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:40.953061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb4ce-8bec-488e-9168-398fd2a7c097 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:40.998212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:40.999446 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:40.999694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:41.000124 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:41.009421 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:41.010823 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:45:41.022941 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:41.024171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:41.025357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 418/833] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:41.030327 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:41.171952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de589177-ca68-41ff-8d71-39d94429aa57 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:41.208098 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737247fd-5056-481b-8b53-395559c3389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:41.208826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737247fd-5056-481b-8b53-395559c3389c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:41.209155 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737247fd-5056-481b-8b53-395559c3389c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:41.209487 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737247fd-5056-481b-8b53-395559c3389c None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:41.210333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737247fd-5056-481b-8b53-395559c3389c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:41.210642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737247fd-5056-481b-8b53-395559c3389c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:41.212858 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737247fd-5056-481b-8b53-395559c3389c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:41.235593 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 416/834] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 21:45:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:41.242755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:41.356980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140907-6dd4-45ef-af07-781d8e0d5021 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:41.390536 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:41.391174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:41.391451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:41.391721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:41.419767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:41.483980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:41.485580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:41.598911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 419/835] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:45:41 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:45:41.605124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737247fd-5056-481b-8b53-395559c3389c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:41.626914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:41.712456 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737247fd-5056-481b-8b53-395559c3389c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:41.750305 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:41.751017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:41.751307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:41.751577 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:41.762153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:41.763733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:41.778991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:41.780144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:41.781109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:41.781109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:41.781109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:41.781109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:41.781109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 417/836] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:45:41.786005 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:41.853353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:41.896358 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528b05-30a2-4c1b-9180-47dda91b5684 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:41.936563 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:41.937483 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:41.937884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:41.938196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:41.939320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:41.939766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:41.941608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:41.954461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 420/837] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:41.960432 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:42.038163 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:42.071491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dae2e-ae98-4eee-9895-b0841323eca6 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:42.107302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:42.107989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:42.108306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:42.108581 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:42.115332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:42.116781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:45:42.128191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:42.129413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:42.130544 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 418/838] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:42.135883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:42.243584 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f1ba0-2fad-4ec7-80bd-f53440fce9ba None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:42.261023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:42.278117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:42.278734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:42.279809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:42.279809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:42.280066 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:42.280339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:42.281868 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45451d3-35bd-418b-93fc-a166ffc0aa7e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:42.299249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 421/839] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:42.305751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:42.425450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840d14-1cec-4c71-954d-9236f017ffa4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:42.460690 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:42.468457 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303656-7b23-4419-be99-13486004e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:42.469140 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303656-7b23-4419-be99-13486004e30c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:42.469441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303656-7b23-4419-be99-13486004e30c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:42.469717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303656-7b23-4419-be99-13486004e30c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:42.471051 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303656-7b23-4419-be99-13486004e30c None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=7ae29498513e43c392540cb257913193) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:42.471477 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303656-7b23-4419-be99-13486004e30c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:42.473710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303656-7b23-4419-be99-13486004e30c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:42.481514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 419/840] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:45:42 2022] GET /identity/v3/role_assignments?user.id=7ae29498513e43c392540cb257913193&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:44.692666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a234598-7434-46bf-a0c4-d95299f384cc None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:44.693255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a234598-7434-46bf-a0c4-d95299f384cc None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:44.693255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a234598-7434-46bf-a0c4-d95299f384cc None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:44.694747 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 422/841] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:45:44.699961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:44.700370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:44.700593 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:44.719421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:44.720599 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:44.793492 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 420/842] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:45:44 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:45:44.817883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a234598-7434-46bf-a0c4-d95299f384cc None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:44.927520 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a234598-7434-46bf-a0c4-d95299f384cc None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:44.967343 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:44.968149 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:44.968489 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:44.968859 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:44.982969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:45:44.985948 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:44.987060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:44.987924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 423/843] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:44.993979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:45.112156 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f97589-7981-4f9f-aafc-2e8cf31c904e None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:45.141886 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:45.155310 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:45.155813 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:45.156134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:45.156425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:45.157181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:45.157557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:45.159073 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:45.169024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 421/844] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:45:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:45.175730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:45.224538 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:45.294749 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4025c-c356-4f36-84c5-8518f347609c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:45.335308 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:45.335986 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:45.336263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:45.336603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:45.347760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:45.349273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:45.368183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:45.369426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:45.370374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:45.370374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:45.370374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:45.370374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:45.370374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 424/845] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:45.375364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:45.489152 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8374-c0db-4121-bb82-510065ff8a15 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:45.526555 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:45.527270 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:45.527552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:45.527826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:45.528512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:45.528843 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:45.530212 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:45.552821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 422/846] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:45.559182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:45.666668 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:45.677090 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558e5b1-cd54-4211-819c-4aa33af1234c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:45.716370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:45.716996 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:45.717273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:45.717648 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] PATH_INFO: `/v3/users/placement` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:45.725821 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:45.728183 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:45:45.741290 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:45.742435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:45.744137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 425/847] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:45.750184 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:45.800561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:45.859353 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4b71-504d-41d6-918f-0764aa3172fb None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:45.899666 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:45.900446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:45.900761 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:45.901034 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:45.901922 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:45.902218 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:45.903736 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:45.924812 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 423/848] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 21:45:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:45.931010 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:46.036397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dc027-ea14-4caa-b2a1-3b60308d85de None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:46.075794 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:46.076430 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:46.076705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:46.076974 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:46.089843 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:46.091627 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:46.108738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:46.109980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:46.111176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:46.111176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:46.111176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:46.111176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:46.112297 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 426/849] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:46.118598 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:46.230317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a525fd-8077-43c7-9f99-aba4a04828f4 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:46.232949 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:46.271499 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:46.272124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:46.272403 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:46.272680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:46.273358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:46.273666 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:46.275624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:46.287428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 424/850] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:46.293441 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:46.296573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:46.400718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7178-8c92-4fc5-a948-40f28310167d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:46.442143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:46.442788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:46.443134 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:46.443439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:46.451729 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:46.453272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:45:46.467476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:46.468692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:46.469852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 427/851] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:45:46.476039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:46.582370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e71833-85a5-4f8c-b7ef-9769ab698e89 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:46.620944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:46.621644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:46.621918 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:46.622192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:46.623089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:46.623425 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:46.625030 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf0a0a-4ef1-49f7-aa74-db84a08b6d52 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:46.639059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 425/852] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:46.645589 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:46.714611 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:46.758691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79da6e-91b2-493a-a709-b73a85fb3572 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:46.796118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50855fb4-1014-417a-96e4-8a3a1e559822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:46.796883 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855fb4-1014-417a-96e4-8a3a1e559822 None admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:46.797190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855fb4-1014-417a-96e4-8a3a1e559822 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:46.797532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855fb4-1014-417a-96e4-8a3a1e559822 None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/7ae29498513e43c392540cb257913193/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:46.814709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50855fb4-1014-417a-96e4-8a3a1e559822 None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=7ae29498513e43c392540cb257913193, role_id=a4a707fcc1cc4a519d6f39cbcc5ce7fe)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:46.816217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50855fb4-1014-417a-96e4-8a3a1e559822 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:46.831677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 428/853] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:45:46 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/7ae29498513e43c392540cb257913193/roles/a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:45:49.133065 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7086-0a4a-45bb-b264-d1535f584606 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:49.133671 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7086-0a4a-45bb-b264-d1535f584606 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:49.133671 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7086-0a4a-45bb-b264-d1535f584606 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:49.135461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 426/854] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:45:49.141075 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:49.141755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:49.141755 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:49.163139 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:49.164353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:49.241591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 429/855] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:45:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:45:49.268195 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d7086-0a4a-45bb-b264-d1535f584606 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:49.297477 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:49.382913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d7086-0a4a-45bb-b264-d1535f584606 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:49.420843 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:49.421507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:49.421821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:49.422120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:49.433056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:45:49.438229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:49.439368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:45:49.440808 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:49.448743 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 427/856] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Jul 25 21:45:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:49.448886 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:49.494252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:49.559587 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f467d4-c929-473e-8387-11c58d32a9df None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:49.595751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:49.596376 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:49.596657 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:49.596931 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:49.597643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] RBAC: Adding query filter params (name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:49.597965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:49.599580 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:49.609737 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 430/857] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Jul 25 21:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:49.616133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:49.711385 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:49.730362 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef5402-ffd6-4bc3-8578-e36def822467 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:49.773444 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:49.774328 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:49.774731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:49.775156 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:49.787139 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:49.789020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:49.804696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:49.806409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:49.812248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:49.812248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:49.812248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:49.812248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:49.812248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 428/858] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:49.812596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:49.922411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75556f71-e9f3-49f8-b0ab-2cb4f555568a None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:49.924851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:49.960433 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:49.961188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:49.962133 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:49.962499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:49.963257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:49.963661 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:49.965712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:49.981558 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 431/859] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:49.987732 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:50.113391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16df2e5-870f-43d2-8805-7acfa5cf4cc9 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:50.156257 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:50.157045 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:50.157346 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:50.157715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:50.161599 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:50.168533 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:50.170578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:45:50.185159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:50.186149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:50.187144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 429/860] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:45:50.193315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:50.312260 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac1f52-7220-400e-ac9b-6905f5029395 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:50.356390 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:50.357035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:50.357379 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:50.357887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:50.358886 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:50.359355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:50.361157 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:50.382749 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 432/861] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 21:45:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:50.389665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:50.509097 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab51b9-ca15-41bf-85f8-0629a611584c None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:50.543947 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:50.544694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:50.544989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:50.545335 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:50.609735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:50.618198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:50.620071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:50.725406 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 430/862] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:45:50 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:45:50.732312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:50.764810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:50.851006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f78f3c-2cbc-47ab-aeea-dff2872037b5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:50.890102 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:50.890880 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:50.891234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:50.891599 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:50.902967 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:50.904673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:50.922664 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:50.923827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:50.924767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:50.924767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:50.924767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:50.924767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:50.924767 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 433/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:50.930656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:51.032656 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:51.039703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26b8f-7a19-4204-a15a-802c55fb12c5 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:51.076990 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:51.077675 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:51.077984 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:51.078299 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:51.079124 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:51.079439 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:51.081979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:51.093928 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 431/864] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:51.100747 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:51.185291 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:51.218719 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153377f-62f0-4aaf-ae11-3d54cb90fa17 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:51.263795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:51.264448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:51.264719 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:51.264989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:51.271990 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:51.273417 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:45:51.284905 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:51.286279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:51.287766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 434/865] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:51.292892 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:51.404326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faba81c-abc9-4812-83d7-4f9157db1663 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:51.444054 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:51.444626 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:51.444908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:51.445183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:51.446091 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:51.446940 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:51.448548 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f406-66ff-446a-b821-b0f36fbf960d None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:51.460782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 432/866] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:51.466884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:51.578527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008993-3eb5-48e2-89a1-a31394557903 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:51.614196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:51.614825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:51.615151 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:51.615428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:51.616228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] RBAC: Adding query filter params (role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=7ae29498513e43c392540cb257913193) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:51.616540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:51.618144 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3359-f18d-48e7-9f15-3d4144ac30b6 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:51.620371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:51.627309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 435/867] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:45:51 2022] GET /identity/v3/role_assignments?user.id=7ae29498513e43c392540cb257913193&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=a4a707fcc1cc4a519d6f39cbcc5ce7fe => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:53.910201 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533495a5-9f89-4d68-bc49-89a40279f6cb None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:53.910771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533495a5-9f89-4d68-bc49-89a40279f6cb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:53.910894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533495a5-9f89-4d68-bc49-89a40279f6cb None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:53.912308 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 433/868] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:45:53.917650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:53.918065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:53.918195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:53.936991 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:53.938180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:54.012706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 436/869] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:45:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:45:54.038783 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533495a5-9f89-4d68-bc49-89a40279f6cb None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:54.059356 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:54.158169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533495a5-9f89-4d68-bc49-89a40279f6cb None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:54.203025 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:54.203699 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:54.203991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:54.204305 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:54.217583 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:45:54.222706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:54.224178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:54.225692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 434/870] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:45:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:54.230621 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:54.341794 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e381d1-cce2-46c4-a1b9-d7150a2817b4 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:54.373778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:54.383490 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:54.384117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:54.384394 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:54.385517 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:54.386239 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:54.386547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:54.388389 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:54.397823 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 437/871] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:45:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:45:54.405433 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:54.500077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:54.531828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53c50e-6c1a-4eac-8bb9-3294ed22ea47 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:54.573332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:54.574013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:54.574289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:54.574621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:54.585149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:54.587171 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:54.604387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:54.610337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:54.611563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:54.611563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:54.611563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:54.611563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:54.611563 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 435/872] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:54.611993 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:54.723056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054def-6362-4be9-983c-5201ec4cc33c None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:54.765914 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:54.766435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:54.766709 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:54.767000 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:54.767683 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:54.767985 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:54.769399 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:54.781181 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 438/873] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:54.787161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:54.894030 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ce0bd-24c6-4bc1-a65a-030156e3d46a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:54.922128 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:54.930970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:54.931615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:54.931891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:54.932156 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:54.941565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:54.943056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:45:54.955830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:54.957122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:54.958089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 436/874] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:54.964207 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:55.016181 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:55.069932 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142ee4-d457-4e12-ab4d-3c29c169b3e3 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:55.108531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:55.109157 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:55.109434 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:55.109705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:55.110493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:55.110796 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:55.112269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:55.130372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 439/875] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 21:45:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:55.137246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:55.253597 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b1cc7-dc53-4f77-be6f-d81566ca28ba None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:55.289318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:55.289852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:55.290127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:55.290396 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:55.349023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:55.363262 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:55.364710 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:55.474762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 437/876] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:45:55 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 21:45:55.480583 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:55.588789 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26735248-e98f-4e8d-aa0b-094bfc19df68 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:55.598931 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:55.625978 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:55.626641 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:55.626938 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:55.627218 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:55.639149 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:55.640622 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:55.659135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:55.660346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:55.661539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:55.661539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:55.661539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:55.661539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:55.663107 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 440/877] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:55.667452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:55.758142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:55.771564 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452575-adde-4b1a-a1c8-a21e20b9fe00 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:55.808145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:55.808777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:55.809055 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:55.809326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:55.810031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:55.810332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:55.811770 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:55.824547 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 438/878] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:55.830496 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:55.934682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afd4d-5fd4-4da4-9295-20aafaa6c92e None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:55.969451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:55.970121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:55.970368 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:55.970634 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:55.978182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:55.979693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:45:55.991497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:55.993095 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:45:55.999253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 441/879] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:56.001280 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:56.107762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdcc51-c690-4e48-a5e4-2133eb0185f2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:56.141486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:56.142275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:56.142692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:56.143170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:56.144370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:56.144953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:56.146987 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62eb150-ab5d-47e4-8f58-607972f8b978 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:56.166201 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 439/880] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:56.172906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:56.199940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:56.282144 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05265ca-cb2e-4601-93e3-e46dad87b755 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:56.315268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:56.315877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:56.316153 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:56.316419 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:56.317188 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=7ae29498513e43c392540cb257913193) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:56.317488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:56.318896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ef0a9-b174-42f2-aa66-0a329fff935e None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:56.324704 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 442/881] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:45:56 2022] GET /identity/v3/role_assignments?user.id=7ae29498513e43c392540cb257913193&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=068868605675478a8abe0ef53a447f78 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:58.509461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429b520-aa34-494b-9cee-5f36af755cb2 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:58.510020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429b520-aa34-494b-9cee-5f36af755cb2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:58.510020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429b520-aa34-494b-9cee-5f36af755cb2 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:58.511366 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 440/882] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:45:58.516471 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:58.516903 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:58.517004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:58.534477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:58.535682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:58.598280 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 443/883] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:45:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:45:58.623043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429b520-aa34-494b-9cee-5f36af755cb2 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:58.633648 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:58.721642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429b520-aa34-494b-9cee-5f36af755cb2 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:58.754057 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:58.754617 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:58.754889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:58.755191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:58.764763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:45:58.769503 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:58.770669 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:58.771960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 441/884] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:58.776965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:58.792116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:58.870588 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c1704-488c-4778-bf0a-1aa7e0d3d419 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:58.904357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:58.904969 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:58.905245 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:58.905516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:58.906221 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:58.906521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:58.907902 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:58.916530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 444/885] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:58.922059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:58.986224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:59.017835 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ef4a-357c-45a9-b705-48495dffe513 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:59.051040 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:59.051670 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:59.051945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:59.052214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:59.061863 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:59.063326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:59.077766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:59.078975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:59.080166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:59.080166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:59.080166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:59.080166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:59.080166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 442/886] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:59.084609 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:59.167113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:59.193174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81605eb1-9a4c-400c-a787-e403cd89828d None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:59.229004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:59.229618 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:59.229899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:59.230176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:59.230859 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:59.231195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:59.232555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:59.243837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 445/887] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:59.249522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:59.344663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19864a4-ea44-4a88-b02c-0007fd68b839 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:59.362823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:59.376092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:59.376705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:59.376975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:59.377244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:59.385522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:59.386974 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:45:59.397628 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:59.399391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:59.400604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 443/888] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:59.404904 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:59.502718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59221c-725f-4d1c-8b44-441cbc8b6125 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:59.535670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:59.536277 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:59.536550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:59.536819 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:59.537843 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:59.538143 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:59.540195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:59.542636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:59.556689 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 446/889] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 21:45:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:59.562663 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:59.658552 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c5844-d715-45f0-b210-baec2250de42 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:59.690522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:59.691166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:59.691443 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:59.691711 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:59.701687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:59.703146 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:45:59.717144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:45:59.718191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:45:59.719175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:45:59.719175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:45:59.719175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:45:59.719175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:45:59.719175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 444/890] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:45:59.723920 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:59.819355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21c707-df07-410f-a881-c430fce45305 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:59.854323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:59.854951 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:59.855236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:59.855510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:59.856192 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:45:59.856494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:59.857846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:59.869090 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 447/891] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:45:59.874680 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:59.908255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:59.975329 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155aa72-b7b0-44ee-91c3-73eb9684c851 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:00.006571 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:00.007223 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:00.007502 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:00.007771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:00.014612 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:00.016069 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:46:00.027543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:00.028620 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:46:00.029771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 445/892] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:00.034579 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:00.091532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:00.140004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622b37-71fe-460d-b4c3-4d8134656427 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:00.178507 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:00.179159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:00.179435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:00.179706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:00.180958 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:00.181255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:00.182673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd1e5-1f0d-4560-ad88-ef63d661dec8 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:00.194156 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 448/893] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:00.200906 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:00.288573 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:00.297586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb588c-2a46-4c83-9ffe-a18632c1d11b None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:00.329938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b759462-5934-4384-85b3-3520bc789264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:00.330587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b759462-5934-4384-85b3-3520bc789264 None admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:00.330865 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b759462-5934-4384-85b3-3520bc789264 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:00.331166 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b759462-5934-4384-85b3-3520bc789264 None admin] PATH_INFO: `/v3/projects/be8e42ad23f3482693d306139f35777a/users/7ae29498513e43c392540cb257913193/roles/068868605675478a8abe0ef53a447f78` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:00.333051 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b759462-5934-4384-85b3-3520bc789264 None admin] RBAC: Authorizing `identity:create_grant(project_id=be8e42ad23f3482693d306139f35777a, user_id=7ae29498513e43c392540cb257913193, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:00.334471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b759462-5934-4384-85b3-3520bc789264 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:00.346199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 446/894] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Jul 25 21:46:00 2022] PUT /identity/v3/projects/be8e42ad23f3482693d306139f35777a/users/7ae29498513e43c392540cb257913193/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:46:02.533833 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54153-f944-4963-aee0-b17d07cc4ba9 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:02.534312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54153-f944-4963-aee0-b17d07cc4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:02.534411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54153-f944-4963-aee0-b17d07cc4ba9 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:02.535750 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 449/895] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:46:02.541849 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:02.542263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:02.542453 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:02.560436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:02.561592 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:02.624991 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 447/896] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:46:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:46:02.650156 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54153-f944-4963-aee0-b17d07cc4ba9 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:02.747947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54153-f944-4963-aee0-b17d07cc4ba9 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:02.761670 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:02.780902 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:02.781531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:02.781810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:02.782082 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:02.792197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:46:02.796987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:02.798097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:02.799190 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 450/897] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Jul 25 21:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:02.804028 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:02.882587 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:02.901396 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae023a-7369-4aa8-9967-ecabb1c698eb None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:02.937056 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:02.937665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:02.937948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:02.938222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:02.938938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:02.939259 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:02.940617 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:02.948398 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 448/898] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Jul 25 21:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:02.953997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:03.049278 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301d76-94cb-42d8-97ec-34570a01a491 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:03.081575 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:03.082196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:03.082475 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:03.082745 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:03.092482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:03.093901 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:46:03.108566 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:03.109654 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:03.110906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:46:03.110906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:46:03.110906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:46:03.110906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:03.110906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 451/899] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:03.115410 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:03.222913 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26d111-7f30-4af4-bea5-b3ebbc7ee0e2 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:03.254772 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:03.255407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:03.255685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:03.255957 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:03.256631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:03.256935 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:03.258303 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:03.269460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 449/900] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:03.275696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:03.302896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:03.371223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c32ef5-edac-42dc-ab77-70106e3edd30 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:03.402616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:03.403257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:03.403532 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:03.403798 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:03.411644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:03.413344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:46:03.424037 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:03.425162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:03.426364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 452/901] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:46:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:03.435036 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:03.438797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:03.539582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dbd80-5d9a-4dca-b2a0-100f9a02d027 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:03.572450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:03.573005 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:03.573263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:03.573534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:03.574305 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:03.574606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:03.576051 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:03.592327 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 450/902] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Jul 25 21:46:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:03.598182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:03.678893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:03.693556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775365c-59f3-4004-8d48-e2579a99aeb5 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:03.725900 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:03.726516 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:03.727307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:03.727597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:03.806665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:03.808125 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:03.885581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:03.900346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 453/903] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Jul 25 21:46:03 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:46:03.906330 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:03.966118 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:04.003538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec047f8-831f-4629-aa33-2ecebff65f1a None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:04.036108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:04.036734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:04.037012 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:04.037286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:04.047762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:04.049187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:46:04.063778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:04.064850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:04.066193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:46:04.066193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:46:04.066193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:46:04.066193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:46:04.066193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 451/904] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:04.070678 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:04.180547 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154c864-da9f-41fc-b372-1bf2487cd6e6 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:04.213345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:04.213959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:04.214252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:04.214512 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:04.215224 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:04.215526 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:04.216885 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:04.227690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 454/905] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Jul 25 21:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:04.233414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:04.329599 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af605f-a299-49c7-bd34-4721ddbe2b89 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:04.342325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:04.362589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:04.363236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:04.363514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:04.363791 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:04.370743 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:04.372198 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:46:04.383861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:04.384929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: ERROR keystone.server.flask.application Jul 25 21:46:04.386066 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 452/906] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Jul 25 21:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:04.390638 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:04.437840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:04.490124 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3f098-d236-44e6-8bed-0b8ed3e91bbc None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:04.522048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:04.522776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:04.523097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:04.523372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:04.524107 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:04.524408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:04.525822 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b84d9-2c01-4520-addd-bf1ac5d5d4dc None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:04.537159 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 455/907] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Jul 25 21:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:04.544020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:04.638441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f13f6-54a7-48c4-a2eb-844bf0852b70 None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:04.670169 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:04.670759 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:04.671064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:04.671333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:04.672093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] RBAC: Adding query filter params (role.id=068868605675478a8abe0ef53a447f78, scope.project.id=be8e42ad23f3482693d306139f35777a, user.id=7ae29498513e43c392540cb257913193) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:04.672394 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:04.673811 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8d5a0-d50a-4bb3-b3c3-07bf8d5b182b None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:04.679306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 453/908] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Jul 25 21:46:04 2022] GET /identity/v3/role_assignments?user.id=7ae29498513e43c392540cb257913193&scope.project.id=be8e42ad23f3482693d306139f35777a&role.id=068868605675478a8abe0ef53a447f78 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:06.878234 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bef94-89ac-4929-a2a0-0fca81c3e446 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:06.878741 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bef94-89ac-4929-a2a0-0fca81c3e446 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:06.878741 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bef94-89ac-4929-a2a0-0fca81c3e446 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:06.880062 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 456/909] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:46:06.885549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:06.885981 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:06.886086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:06.904300 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:06.905465 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:06.934214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:06.971108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 454/910] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:46:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:46:06.993848 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bef94-89ac-4929-a2a0-0fca81c3e446 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:07.090675 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bef94-89ac-4929-a2a0-0fca81c3e446 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:07.098267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:07.124247 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:07.124877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:07.125150 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:07.125420 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:07.126256 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:07.127822 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:07.137691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:07.139039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:07.140113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 457/911] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 21:46:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:07.144734 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:07.250979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba7163-935d-4dd6-8c4e-2948952b5ec8 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:07.283263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:07.283868 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:07.284142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:07.284409 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:07.285071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:07.285369 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:07.286714 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620861-8a19-4d17-8f01-a2e6d93cbce9 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:07.291512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 455/912] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 21:46:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:07.297451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:07.392439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b21817-7c56-46b6-8e7a-f7956617d117 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:07.424426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:07.425017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:07.425289 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:07.425556 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] PATH_INFO: `/v3/services` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:07.426211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:07.426508 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:07.427878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ba3ae-10a6-4bfa-930b-067734889455 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:07.432645 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 458/913] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 21:46:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:46:09.642055 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebde88-13f5-4c1a-bfb4-2f7f920dd4c9 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:09.642579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebde88-13f5-4c1a-bfb4-2f7f920dd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:09.642579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebde88-13f5-4c1a-bfb4-2f7f920dd4c9 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:09.643953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 456/914] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:46:09.649108 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b537-fcde-40da-b161-1bc5cd098228 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:09.649510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b537-fcde-40da-b161-1bc5cd098228 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:09.649663 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b537-fcde-40da-b161-1bc5cd098228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:09.668029 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-42b9b537-fcde-40da-b161-1bc5cd098228 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:09.669223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-42b9b537-fcde-40da-b161-1bc5cd098228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:09.695056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:09.733856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 459/915] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:46:09 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:46:09.757397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebde88-13f5-4c1a-bfb4-2f7f920dd4c9 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:09.788306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:09.858125 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebde88-13f5-4c1a-bfb4-2f7f920dd4c9 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:09.891185 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d52ca6-80a4-4cbb-83e4-721e27295a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:09.891795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d52ca6-80a4-4cbb-83e4-721e27295a81 None admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:09.892078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d52ca6-80a4-4cbb-83e4-721e27295a81 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:09.892355 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d52ca6-80a4-4cbb-83e4-721e27295a81 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:09.893050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d52ca6-80a4-4cbb-83e4-721e27295a81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:09.894435 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d52ca6-80a4-4cbb-83e4-721e27295a81 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:09.911560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 457/916] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Jul 25 21:46:09 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:46:12.186557 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abdda8-5f27-4be4-bf68-5b0e9478e027 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:12.187128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abdda8-5f27-4be4-bf68-5b0e9478e027 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:12.187128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abdda8-5f27-4be4-bf68-5b0e9478e027 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:12.188476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 460/917] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:46:12.193531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:12.193908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:12.194089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:12.214778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:12.216199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:12.287339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 458/918] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:46:12 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:46:12.311765 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abdda8-5f27-4be4-bf68-5b0e9478e027 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:12.407273 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abdda8-5f27-4be4-bf68-5b0e9478e027 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:12.439396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:12.439953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:12.440225 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:12.440489 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] PATH_INFO: `/v3/services/placement` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:12.441098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:12.442443 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:12.451494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:12.452506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:12.453432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 461/919] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 21:46:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:12.459050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:12.486542 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:12.566751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a172ff3-7bba-4f9f-8700-d299ed4463fb None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:12.599929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:12.600529 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:12.600802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:12.601072 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:12.602222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] RBAC: Adding query filter params (name=placement) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:12.602523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:12.603953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:12.608805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 459/920] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 21:46:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:12.614763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:12.642552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:12.711067 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294cad1-0a2c-4748-b6e6-8cba4922c1ce None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:12.742937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:12.743557 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:12.743837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:12.744111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:12.744851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] RBAC: Adding query filter params (interface=public, service_id=97b6646742c149e6bd583f0ef8939c2e, region_id=RegionOne) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:12.745158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:12.746513 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3a908-2894-42ba-9a51-a371351b20c2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:12.751380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 462/921] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Jul 25 21:46:12 2022] GET /identity/v3/endpoints?service_id=97b6646742c149e6bd583f0ef8939c2e&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:12.757031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:12.839083 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:12.856748 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df055f0e-7414-4963-a172-c6fc5841bcdb None admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:12.889031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1383b3-cf92-4815-bb6f-cfd7f9997f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:12.889640 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1383b3-cf92-4815-bb6f-cfd7f9997f34 None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:12.889918 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1383b3-cf92-4815-bb6f-cfd7f9997f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:12.890191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1383b3-cf92-4815-bb6f-cfd7f9997f34 None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:12.890829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1383b3-cf92-4815-bb6f-cfd7f9997f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:12.892204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1383b3-cf92-4815-bb6f-cfd7f9997f34 None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:12.898474 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 460/922] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Jul 25 21:46:12 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:46:15.077542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217e43-e22f-4f35-ae15-dc5aa154fba2 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:15.078074 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217e43-e22f-4f35-ae15-dc5aa154fba2 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:15.078074 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1217e43-e22f-4f35-ae15-dc5aa154fba2 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:15.079461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 463/923] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:46:15.084450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:15.084824 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:15.084985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:15.102854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:15.104041 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:15.167621 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 461/924] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:46:15 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:46:15.191381 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217e43-e22f-4f35-ae15-dc5aa154fba2 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:15.279842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:15.289482 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1217e43-e22f-4f35-ae15-dc5aa154fba2 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:15.322258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:15.322882 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:15.323184 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:15.323451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:15.324059 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:15.325397 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:46:15.334103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:46:15.335320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application with Lock( Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: ERROR keystone.server.flask.application Jul 25 21:46:15.336212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 464/925] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Jul 25 21:46:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:46:15.341350 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:15.414220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:15.436496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f8609-5ccc-41ed-a81e-cb18441f4156 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:15.469045 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:15.469658 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:15.469935 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:15.470204 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] PATH_INFO: `/v3/services` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:15.470877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:46:15.471208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:15.472569 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b70dc-5640-4d24-8942-1af95acf41bb None admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:15.477576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 462/926] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Jul 25 21:46:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:46:15.483321 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:15.579128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a39b-9011-43ff-b477-8ce14148cab9 None admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:15.610739 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2554a0c-29f5-4e8b-85f4-e241a15d9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:15.611310 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554a0c-29f5-4e8b-85f4-e241a15d9eb2 None admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:15.611588 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554a0c-29f5-4e8b-85f4-e241a15d9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:15.611860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2554a0c-29f5-4e8b-85f4-e241a15d9eb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:15.612570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2554a0c-29f5-4e8b-85f4-e241a15d9eb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:15.613922 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2554a0c-29f5-4e8b-85f4-e241a15d9eb2 None admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:15.633471 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 465/927] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:46:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:46:25.475036 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=30 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:25.629284 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:47:14.050819 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fef4e-a436-40ea-a440-0af19a4415a2 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:14.051448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fef4e-a436-40ea-a440-0af19a4415a2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:14.051448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fef4e-a436-40ea-a440-0af19a4415a2 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:14.055416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 463/928] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:14.058404 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8689111-b4c3-4cef-a4c5-534ce0e340be None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:14.058840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8689111-b4c3-4cef-a4c5-534ce0e340be None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:14.058992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8689111-b4c3-4cef-a4c5-534ce0e340be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:14.079870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-a8689111-b4c3-4cef-a4c5-534ce0e340be None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:14.082007 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-a8689111-b4c3-4cef-a4c5-534ce0e340be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:14.169166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 466/929] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:14.222064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3aab6-0073-42ca-b8f6-3f136c476465 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:14.222352 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3aab6-0073-42ca-b8f6-3f136c476465 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:14.222634 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3aab6-0073-42ca-b8f6-3f136c476465 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:14.224033 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 464/930] 10.222.0.18 () {54 vars in 965 bytes} [Mon Jul 25 21:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:14.231358 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c921ae-85fb-4b97-af73-9617e0e8746f None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:14.231742 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c921ae-85fb-4b97-af73-9617e0e8746f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:14.231924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c921ae-85fb-4b97-af73-9617e0e8746f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:14.306271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-89c921ae-85fb-4b97-af73-9617e0e8746f None None] MFA Rules not processed for user `7ae653f590784ee894b3d00dd83790f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:14.307510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-89c921ae-85fb-4b97-af73-9617e0e8746f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:14.373989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 467/931] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Jul 25 21:47:14 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:14.386088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3aab6-0073-42ca-b8f6-3f136c476465 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:14.395756 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3aab6-0073-42ca-b8f6-3f136c476465 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:14.399655 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c2164-18a5-4c3c-8256-615ad287cb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:14.400149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2164-18a5-4c3c-8256-615ad287cb23 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:14.400149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2164-18a5-4c3c-8256-615ad287cb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:14.400745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c2164-18a5-4c3c-8256-615ad287cb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:14.409414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c2164-18a5-4c3c-8256-615ad287cb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:14.410833 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c2164-18a5-4c3c-8256-615ad287cb23 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:14.431318 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 465/932] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:16.969541 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a496f-70b7-4429-aa36-a675bf3105d5 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:16.970081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a496f-70b7-4429-aa36-a675bf3105d5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:16.970081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a496f-70b7-4429-aa36-a675bf3105d5 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:16.971777 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 468/933] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:16.977113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34693d6-03de-41e4-8cce-9debfd39f255 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:16.977968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34693d6-03de-41e4-8cce-9debfd39f255 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:16.978237 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34693d6-03de-41e4-8cce-9debfd39f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:16.999549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-f34693d6-03de-41e4-8cce-9debfd39f255 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:17.001077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-f34693d6-03de-41e4-8cce-9debfd39f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:17.009874 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 466/934] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:17.048758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a496f-70b7-4429-aa36-a675bf3105d5 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:17.059813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a496f-70b7-4429-aa36-a675bf3105d5 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:17.063170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b9ec2-6a54-4a34-ad25-f33d84ec2b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:17.063774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b9ec2-6a54-4a34-ad25-f33d84ec2b97 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:17.064048 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b9ec2-6a54-4a34-ad25-f33d84ec2b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:17.064314 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b9ec2-6a54-4a34-ad25-f33d84ec2b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:17.074252 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b9ec2-6a54-4a34-ad25-f33d84ec2b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:17.075717 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b9ec2-6a54-4a34-ad25-f33d84ec2b97 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:17.085680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 469/935] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:47:19.692455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2436e-18ca-43cb-ac27-4b63afd2e861 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:19.692980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2436e-18ca-43cb-ac27-4b63afd2e861 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:19.692980 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2436e-18ca-43cb-ac27-4b63afd2e861 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:19.695740 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 467/936] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:19.700253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee43c-e21a-44ed-812f-d57c3ccab5dc None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:19.700734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee43c-e21a-44ed-812f-d57c3ccab5dc None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:19.700835 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee43c-e21a-44ed-812f-d57c3ccab5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:19.736442 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c49ee43c-e21a-44ed-812f-d57c3ccab5dc None None] MFA Rules not processed for user `03092f47767a46b399baeb618ef35c79`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:19.737557 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c49ee43c-e21a-44ed-812f-d57c3ccab5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:19.777332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:47:19.805279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 470/937] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:19 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:19.858102 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ea413-e022-4961-9275-cb7bfb595ab9 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:19.858470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ea413-e022-4961-9275-cb7bfb595ab9 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:19.858805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ea413-e022-4961-9275-cb7bfb595ab9 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:19.860230 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 468/938] 10.222.0.18 () {54 vars in 965 bytes} [Mon Jul 25 21:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:19.866514 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037558-8316-4ace-ba99-82829715dd9f None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:19.866799 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037558-8316-4ace-ba99-82829715dd9f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:19.867102 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037558-8316-4ace-ba99-82829715dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:19.889626 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-e1037558-8316-4ace-ba99-82829715dd9f None None] MFA Rules not processed for user `7ae653f590784ee894b3d00dd83790f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:19.890815 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-e1037558-8316-4ace-ba99-82829715dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:19.897201 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 471/939] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Jul 25 21:47:19 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:19.905837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ea413-e022-4961-9275-cb7bfb595ab9 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:19.916615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ea413-e022-4961-9275-cb7bfb595ab9 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:19.920118 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33f37b-bbc1-4715-96aa-5105ad199f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:19.920751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33f37b-bbc1-4715-96aa-5105ad199f54 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:19.921032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33f37b-bbc1-4715-96aa-5105ad199f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:19.921306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33f37b-bbc1-4715-96aa-5105ad199f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:19.930534 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33f37b-bbc1-4715-96aa-5105ad199f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:19.931993 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33f37b-bbc1-4715-96aa-5105ad199f54 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:19.941159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 469/940] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:19 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:47:23.134094 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b99a31-c8ca-4744-b48d-5348e13adb54 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:23.134690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b99a31-c8ca-4744-b48d-5348e13adb54 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:23.134780 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b99a31-c8ca-4744-b48d-5348e13adb54 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:23.136550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 472/941] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:47:23.142400 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2816-2a49-41af-9fc3-480e6b0953d1 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:23.142797 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2816-2a49-41af-9fc3-480e6b0953d1 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:23.142979 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2816-2a49-41af-9fc3-480e6b0953d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:23.162202 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d03d2816-2a49-41af-9fc3-480e6b0953d1 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:23.163420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d03d2816-2a49-41af-9fc3-480e6b0953d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:23.228648 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 470/942] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:23 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:23.269731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b99a31-c8ca-4744-b48d-5348e13adb54 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:23.280770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b99a31-c8ca-4744-b48d-5348e13adb54 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:23.284119 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1471d9-8c28-48e2-a13b-e4bbbbf52cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:23.284715 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1471d9-8c28-48e2-a13b-e4bbbbf52cfb service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:23.284987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1471d9-8c28-48e2-a13b-e4bbbbf52cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:23.285256 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1471d9-8c28-48e2-a13b-e4bbbbf52cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:23.293921 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1471d9-8c28-48e2-a13b-e4bbbbf52cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:23.295372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1471d9-8c28-48e2-a13b-e4bbbbf52cfb service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:23.304294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 473/943] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:23 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:26.214837 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140cf86-e478-4108-b3ab-67210deca413 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:26.215404 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140cf86-e478-4108-b3ab-67210deca413 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:26.215404 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140cf86-e478-4108-b3ab-67210deca413 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:26.216924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 471/944] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:26.221806 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bad3-18ad-41a1-a3aa-8f6925de0a26 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:26.222231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bad3-18ad-41a1-a3aa-8f6925de0a26 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:26.222502 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bad3-18ad-41a1-a3aa-8f6925de0a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:26.242954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-9fc8bad3-18ad-41a1-a3aa-8f6925de0a26 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:26.244163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-9fc8bad3-18ad-41a1-a3aa-8f6925de0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:26.251852 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 474/945] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:26.289579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140cf86-e478-4108-b3ab-67210deca413 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:26.300466 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140cf86-e478-4108-b3ab-67210deca413 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:26.307895 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c17d1-acae-43b2-b788-3839e723a07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:26.308557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c17d1-acae-43b2-b788-3839e723a07d service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:26.308831 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c17d1-acae-43b2-b788-3839e723a07d service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:26.309724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c17d1-acae-43b2-b788-3839e723a07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:26.320647 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c17d1-acae-43b2-b788-3839e723a07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:26.322095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c17d1-acae-43b2-b788-3839e723a07d service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:26.331493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 472/946] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:28.579386 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a627b-45b1-42e3-b793-33c3acf9daaf None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:28.579906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a627b-45b1-42e3-b793-33c3acf9daaf None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:28.579906 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a627b-45b1-42e3-b793-33c3acf9daaf None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:28.581201 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 475/947] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:28.586382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4f76-555d-4489-98aa-c5aa4deb28a0 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:28.586789 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4f76-555d-4489-98aa-c5aa4deb28a0 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:28.586961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b4f76-555d-4489-98aa-c5aa4deb28a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:28.607591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-e06b4f76-555d-4489-98aa-c5aa4deb28a0 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:28.608773 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e06b4f76-555d-4489-98aa-c5aa4deb28a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:28.617263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 473/948] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:28.653006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a627b-45b1-42e3-b793-33c3acf9daaf None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:28.664225 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a627b-45b1-42e3-b793-33c3acf9daaf None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:28.667696 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48833bd9-1dc4-4730-8304-6d632ff58a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:28.668370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48833bd9-1dc4-4730-8304-6d632ff58a34 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:28.668716 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48833bd9-1dc4-4730-8304-6d632ff58a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:28.669056 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48833bd9-1dc4-4730-8304-6d632ff58a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:28.677822 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48833bd9-1dc4-4730-8304-6d632ff58a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:28.679331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48833bd9-1dc4-4730-8304-6d632ff58a34 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:28.688675 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 476/949] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:30.995463 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ba434-e428-4c81-ac70-4589979715af None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:30.996054 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ba434-e428-4c81-ac70-4589979715af None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:30.996054 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ba434-e428-4c81-ac70-4589979715af None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:30.997474 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 474/950] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:31.002458 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216627-241b-4aa5-90fc-238bcd150a10 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:31.002911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216627-241b-4aa5-90fc-238bcd150a10 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:31.003054 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216627-241b-4aa5-90fc-238bcd150a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:31.022311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-a5216627-241b-4aa5-90fc-238bcd150a10 None None] MFA Rules not processed for user `03092f47767a46b399baeb618ef35c79`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:31.023518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-a5216627-241b-4aa5-90fc-238bcd150a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:31.031302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 477/951] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:31 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:31.070613 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ba434-e428-4c81-ac70-4589979715af None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:31.080932 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ba434-e428-4c81-ac70-4589979715af None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:31.084828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20277fca-f8ec-4c24-8b10-361f6f9d7c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:31.085419 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20277fca-f8ec-4c24-8b10-361f6f9d7c99 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:31.085692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20277fca-f8ec-4c24-8b10-361f6f9d7c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:31.085954 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20277fca-f8ec-4c24-8b10-361f6f9d7c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:31.094572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20277fca-f8ec-4c24-8b10-361f6f9d7c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:31.096059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20277fca-f8ec-4c24-8b10-361f6f9d7c99 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:31.105801 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 475/952] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:31 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:33.559856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11511b3e-6454-49bc-97ec-a01c8e8e1cf0 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:33.560395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11511b3e-6454-49bc-97ec-a01c8e8e1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:33.560395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11511b3e-6454-49bc-97ec-a01c8e8e1cf0 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:33.561667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 478/953] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:33.567192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32821-3794-4f56-b9c3-ef7f658071c4 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:33.567717 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32821-3794-4f56-b9c3-ef7f658071c4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:33.567870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32821-3794-4f56-b9c3-ef7f658071c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:33.588255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b9c32821-3794-4f56-b9c3-ef7f658071c4 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:33.589494 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b9c32821-3794-4f56-b9c3-ef7f658071c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:33.597455 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 476/954] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:33.635965 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11511b3e-6454-49bc-97ec-a01c8e8e1cf0 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:33.648004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11511b3e-6454-49bc-97ec-a01c8e8e1cf0 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:33.651658 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a188b-cddd-4c88-99ea-d572bf152997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:33.652388 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a188b-cddd-4c88-99ea-d572bf152997 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:33.652732 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a188b-cddd-4c88-99ea-d572bf152997 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:33.653070 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a188b-cddd-4c88-99ea-d572bf152997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:33.663118 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a188b-cddd-4c88-99ea-d572bf152997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:33.664813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a188b-cddd-4c88-99ea-d572bf152997 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:33.675117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 479/955] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:47:35.990911 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2d499-021a-43f5-ba00-01c5945f5ea9 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:35.991479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2d499-021a-43f5-ba00-01c5945f5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:35.991479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2d499-021a-43f5-ba00-01c5945f5ea9 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:35.992821 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 477/956] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:35.997940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194447ef-0168-4016-a1e0-ac1a093e2b67 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:35.998331 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194447ef-0168-4016-a1e0-ac1a093e2b67 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:35.998497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194447ef-0168-4016-a1e0-ac1a093e2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:36.017714 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-194447ef-0168-4016-a1e0-ac1a093e2b67 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:36.018895 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-194447ef-0168-4016-a1e0-ac1a093e2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:36.027216 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 480/957] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:36.067964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2d499-021a-43f5-ba00-01c5945f5ea9 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:36.073802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=65 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:47:36.079802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2d499-021a-43f5-ba00-01c5945f5ea9 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:36.083236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c6939-0f55-43f8-8c01-548afaab0e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:36.083841 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c6939-0f55-43f8-8c01-548afaab0e27 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:36.084664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c6939-0f55-43f8-8c01-548afaab0e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:36.084937 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c6939-0f55-43f8-8c01-548afaab0e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:36.093962 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c6939-0f55-43f8-8c01-548afaab0e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:36.095434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c6939-0f55-43f8-8c01-548afaab0e27 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:36.104687 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 478/958] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:38.792097 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df197e-49dc-4195-b257-a0abd577ce65 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:38.792625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df197e-49dc-4195-b257-a0abd577ce65 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:38.792625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df197e-49dc-4195-b257-a0abd577ce65 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:38.793878 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 481/959] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:38.798956 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ed7b-c0a1-4a7e-bc14-612e037e5984 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:38.799380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ed7b-c0a1-4a7e-bc14-612e037e5984 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:38.799498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95ed7b-c0a1-4a7e-bc14-612e037e5984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:38.819517 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-3f95ed7b-c0a1-4a7e-bc14-612e037e5984 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:38.820723 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3f95ed7b-c0a1-4a7e-bc14-612e037e5984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:38.828345 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 479/960] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:38 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:38.865728 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df197e-49dc-4195-b257-a0abd577ce65 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:38.875995 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df197e-49dc-4195-b257-a0abd577ce65 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:38.879333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ababf2-100b-4c59-863f-bd92212903a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:38.879924 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ababf2-100b-4c59-863f-bd92212903a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:38.880195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ababf2-100b-4c59-863f-bd92212903a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:38.880460 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ababf2-100b-4c59-863f-bd92212903a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:38.888885 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ababf2-100b-4c59-863f-bd92212903a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:38.890294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ababf2-100b-4c59-863f-bd92212903a8 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:38.899278 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 482/961] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:38 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:43.160187 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae1f83-1851-4372-af58-f63011b90ac5 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:43.160695 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae1f83-1851-4372-af58-f63011b90ac5 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:43.160695 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae1f83-1851-4372-af58-f63011b90ac5 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:43.162586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 480/962] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:43.168205 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c6981-7ed7-48c0-a8b5-22c76c6c07d5 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:43.168590 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c6981-7ed7-48c0-a8b5-22c76c6c07d5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:43.168764 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c6981-7ed7-48c0-a8b5-22c76c6c07d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:43.187521 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c41c6981-7ed7-48c0-a8b5-22c76c6c07d5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:43.188701 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c41c6981-7ed7-48c0-a8b5-22c76c6c07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:43.196322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 483/963] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:43.236566 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae1f83-1851-4372-af58-f63011b90ac5 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:43.246850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae1f83-1851-4372-af58-f63011b90ac5 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:43.250340 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581ebae-c703-4d3a-aed6-8dd080350831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:43.250953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ebae-c703-4d3a-aed6-8dd080350831 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:43.251229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ebae-c703-4d3a-aed6-8dd080350831 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:43.251494 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ebae-c703-4d3a-aed6-8dd080350831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:43.260047 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581ebae-c703-4d3a-aed6-8dd080350831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:43.261489 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581ebae-c703-4d3a-aed6-8dd080350831 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:43.270535 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 481/964] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:46.109086 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbd3e-d365-419e-a5ad-d173415472b3 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:46.109563 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbd3e-d365-419e-a5ad-d173415472b3 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:46.109667 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbd3e-d365-419e-a5ad-d173415472b3 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:46.111018 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 484/965] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:46.116240 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17658-71c3-4169-87a1-aa558257fcaf None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:46.116677 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17658-71c3-4169-87a1-aa558257fcaf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:46.116908 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17658-71c3-4169-87a1-aa558257fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:46.135615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-a3c17658-71c3-4169-87a1-aa558257fcaf None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:46.137007 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-a3c17658-71c3-4169-87a1-aa558257fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:46.145183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 482/966] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:46 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:47:46.183705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbd3e-d365-419e-a5ad-d173415472b3 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:46.194787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbd3e-d365-419e-a5ad-d173415472b3 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:46.198226 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea13ca9-bb0a-403c-bc41-2458af0b3e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:46.198832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13ca9-bb0a-403c-bc41-2458af0b3e89 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:46.199138 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13ca9-bb0a-403c-bc41-2458af0b3e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:46.199403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea13ca9-bb0a-403c-bc41-2458af0b3e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:46.208270 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea13ca9-bb0a-403c-bc41-2458af0b3e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:46.210174 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea13ca9-bb0a-403c-bc41-2458af0b3e89 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:46.219304 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 485/967] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:46 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:50.669489 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92fab-43ea-4a9f-9a9e-aae7e0c24926 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:50.670007 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92fab-43ea-4a9f-9a9e-aae7e0c24926 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:50.670007 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92fab-43ea-4a9f-9a9e-aae7e0c24926 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:50.671407 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 483/968] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:47:50.676812 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce3940-8938-4775-bf4f-53d15b87e53e None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:50.677341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce3940-8938-4775-bf4f-53d15b87e53e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:50.677341 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce3940-8938-4775-bf4f-53d15b87e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:50.686635 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=57 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:47:50.700249 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-abce3940-8938-4775-bf4f-53d15b87e53e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:50.701479 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-abce3940-8938-4775-bf4f-53d15b87e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:50.711015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 486/969] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:47:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:47:50.750072 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92fab-43ea-4a9f-9a9e-aae7e0c24926 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:50.761525 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92fab-43ea-4a9f-9a9e-aae7e0c24926 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:50.765249 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d30100-4797-4ce4-802d-60e7bae5f9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:50.765938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d30100-4797-4ce4-802d-60e7bae5f9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:50.766280 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d30100-4797-4ce4-802d-60e7bae5f9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:50.766616 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d30100-4797-4ce4-802d-60e7bae5f9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:50.777157 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d30100-4797-4ce4-802d-60e7bae5f9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:50.778614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d30100-4797-4ce4-802d-60e7bae5f9b6 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:50.789247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 484/970] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:56.253195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f985-1ed2-4064-b324-aedd77c7fd99 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:56.253694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f985-1ed2-4064-b324-aedd77c7fd99 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:56.253694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f985-1ed2-4064-b324-aedd77c7fd99 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:56.255717 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 487/971] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 21:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:56.260492 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3424b-a332-4629-8641-2f5e785ae9ff None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:56.260918 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3424b-a332-4629-8641-2f5e785ae9ff None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:56.261215 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3424b-a332-4629-8641-2f5e785ae9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:56.344082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b9e3424b-a332-4629-8641-2f5e785ae9ff None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:56.345438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b9e3424b-a332-4629-8641-2f5e785ae9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:56.433917 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 485/972] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 21:47:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:00.695100 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=2 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:00.815406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c50c-6ab0-4665-83fb-e0c5afbb4db4 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:00.815745 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c50c-6ab0-4665-83fb-e0c5afbb4db4 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:00.815987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c50c-6ab0-4665-83fb-e0c5afbb4db4 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:00.817592 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 488/973] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 21:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:00.822642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6dd9-7531-4c25-bb76-190ec4aea03e None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:00.823615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6dd9-7531-4c25-bb76-190ec4aea03e None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:00.824150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a6dd9-7531-4c25-bb76-190ec4aea03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:00.847997 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-a70a6dd9-7531-4c25-bb76-190ec4aea03e None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:00.852554 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-a70a6dd9-7531-4c25-bb76-190ec4aea03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:00.868346 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 486/974] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 21:48:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:02.507000 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0588f3-f573-40d1-8361-542060255b4d None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:02.507497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0588f3-f573-40d1-8361-542060255b4d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:02.507724 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0588f3-f573-40d1-8361-542060255b4d None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:02.509155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 489/975] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 21:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:02.514194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b8de-c4e3-41ff-a976-bea8647cedbe None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:02.514600 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b8de-c4e3-41ff-a976-bea8647cedbe None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:02.514739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b8de-c4e3-41ff-a976-bea8647cedbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:02.534876 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-1dc4b8de-c4e3-41ff-a976-bea8647cedbe None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:02.536691 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-1dc4b8de-c4e3-41ff-a976-bea8647cedbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:02.545337 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 487/976] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 21:48:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:48:06.391467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad333edb-5bbf-418d-9f58-ad1744b7b5ed None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:06.392028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad333edb-5bbf-418d-9f58-ad1744b7b5ed None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:06.392028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad333edb-5bbf-418d-9f58-ad1744b7b5ed None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:06.393203 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 490/977] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:06.398378 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3e2d-0d02-4743-a560-2099f5c5c2d4 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:06.398798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3e2d-0d02-4743-a560-2099f5c5c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:06.398890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3e2d-0d02-4743-a560-2099f5c5c2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:06.406313 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=69 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:06.419222 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-819b3e2d-0d02-4743-a560-2099f5c5c2d4 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:06.420389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-819b3e2d-0d02-4743-a560-2099f5c5c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:06.428665 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 488/978] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:06.488322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534da542-0698-4148-aefe-d0da4804a203 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:06.489261 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534da542-0698-4148-aefe-d0da4804a203 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:06.489677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534da542-0698-4148-aefe-d0da4804a203 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:06.491164 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 491/979] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 21:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:06.508591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbddc8-08be-4997-a34f-d2a4b90efabe None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:06.508870 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbddc8-08be-4997-a34f-d2a4b90efabe None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:06.509325 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbddc8-08be-4997-a34f-d2a4b90efabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:06.547608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-61dbddc8-08be-4997-a34f-d2a4b90efabe None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:06.548766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-61dbddc8-08be-4997-a34f-d2a4b90efabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:06.619742 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 489/980] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 21:48:06 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:06.628457 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534da542-0698-4148-aefe-d0da4804a203 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:06.645531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534da542-0698-4148-aefe-d0da4804a203 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:06.651304 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16ca5a-2a92-4794-9ad2-9720e4397e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:06.652034 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ca5a-2a92-4794-9ad2-9720e4397e2b service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:06.652411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ca5a-2a92-4794-9ad2-9720e4397e2b service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:06.652786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16ca5a-2a92-4794-9ad2-9720e4397e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:06.661359 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16ca5a-2a92-4794-9ad2-9720e4397e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:06.663309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16ca5a-2a92-4794-9ad2-9720e4397e2b service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:06.683031 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 492/981] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:09.139619 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fcc5a-a0ef-4a1b-8a37-23fd60c92954 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:09.140179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fcc5a-a0ef-4a1b-8a37-23fd60c92954 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:09.140179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fcc5a-a0ef-4a1b-8a37-23fd60c92954 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:09.141658 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 490/982] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:09.147223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff1a0f-88f5-4e26-a56a-2ddb6149769a None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:09.147653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff1a0f-88f5-4e26-a56a-2ddb6149769a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:09.147772 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff1a0f-88f5-4e26-a56a-2ddb6149769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:09.167096 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c4ff1a0f-88f5-4e26-a56a-2ddb6149769a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:09.168297 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c4ff1a0f-88f5-4e26-a56a-2ddb6149769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:09.177153 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 493/983] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:09.222720 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fcc5a-a0ef-4a1b-8a37-23fd60c92954 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:09.237515 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fcc5a-a0ef-4a1b-8a37-23fd60c92954 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:09.243071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d22c-5bdf-474a-b43b-d645141523db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:09.243841 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d22c-5bdf-474a-b43b-d645141523db service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:09.244304 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d22c-5bdf-474a-b43b-d645141523db service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:09.244646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d22c-5bdf-474a-b43b-d645141523db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:09.253101 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61d22c-5bdf-474a-b43b-d645141523db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:09.254780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61d22c-5bdf-474a-b43b-d645141523db service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:09.264611 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 491/984] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:11.822179 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46eb8-d850-4bf3-99de-6a8d925ca838 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:11.822633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46eb8-d850-4bf3-99de-6a8d925ca838 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:11.822756 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a46eb8-d850-4bf3-99de-6a8d925ca838 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:11.824210 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 494/985] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:11.833190 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d90cd-5e0d-42a2-bdf2-562348a8f7cd None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:11.833190 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d90cd-5e0d-42a2-bdf2-562348a8f7cd None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:11.833190 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d90cd-5e0d-42a2-bdf2-562348a8f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:11.850998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-318d90cd-5e0d-42a2-bdf2-562348a8f7cd None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:11.852181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-318d90cd-5e0d-42a2-bdf2-562348a8f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:11.859975 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 492/986] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:11.905197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9472-13ed-4874-921c-83dc260d090e None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:11.905485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9472-13ed-4874-921c-83dc260d090e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:11.905760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9472-13ed-4874-921c-83dc260d090e None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:11.907172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 495/987] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 21:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:11.914983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b099-9b74-401c-9226-9ef36a216186 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:11.914983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b099-9b74-401c-9226-9ef36a216186 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:11.914983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6b099-9b74-401c-9226-9ef36a216186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:11.938786 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d2d6b099-9b74-401c-9226-9ef36a216186 None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:11.940084 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d2d6b099-9b74-401c-9226-9ef36a216186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:11.948508 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 493/988] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 21:48:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:11.956132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9472-13ed-4874-921c-83dc260d090e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:11.970182 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9472-13ed-4874-921c-83dc260d090e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:11.975847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9b5a1-07a2-4f7b-bfb4-977dfaa11332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:11.976467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9b5a1-07a2-4f7b-bfb4-977dfaa11332 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:11.976742 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9b5a1-07a2-4f7b-bfb4-977dfaa11332 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:11.977015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9b5a1-07a2-4f7b-bfb4-977dfaa11332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:11.985927 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9b5a1-07a2-4f7b-bfb4-977dfaa11332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:11.987799 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9b5a1-07a2-4f7b-bfb4-977dfaa11332 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:11.998078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 496/989] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:14.585089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021596-f49c-45d4-8688-711bdf85870a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:14.585945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021596-f49c-45d4-8688-711bdf85870a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:14.586395 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021596-f49c-45d4-8688-711bdf85870a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:14.589172 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 494/990] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:14.594201 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247789f-0d46-4abf-8237-36b1aa1d79ec None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:14.595024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247789f-0d46-4abf-8237-36b1aa1d79ec None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:14.596179 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247789f-0d46-4abf-8237-36b1aa1d79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:14.630044 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-8247789f-0d46-4abf-8237-36b1aa1d79ec None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:14.631511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-8247789f-0d46-4abf-8237-36b1aa1d79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:14.641332 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 497/991] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:14.697452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021596-f49c-45d4-8688-711bdf85870a None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:14.717952 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021596-f49c-45d4-8688-711bdf85870a None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:14.724383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fe575-cf56-4b3d-8f52-3e08ae1a2b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:14.728616 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fe575-cf56-4b3d-8f52-3e08ae1a2b3f service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:14.729087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fe575-cf56-4b3d-8f52-3e08ae1a2b3f service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:14.729512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fe575-cf56-4b3d-8f52-3e08ae1a2b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:14.739629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fe575-cf56-4b3d-8f52-3e08ae1a2b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:14.741759 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fe575-cf56-4b3d-8f52-3e08ae1a2b3f service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:14.754733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 495/992] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:16.879494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb12cd6-7be1-40fe-a54c-689bc8927053 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:16.880043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb12cd6-7be1-40fe-a54c-689bc8927053 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:16.880043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb12cd6-7be1-40fe-a54c-689bc8927053 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:16.883117 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 498/993] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:16.886595 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2cb4-c532-49e3-b174-a6525960210b None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:16.887479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2cb4-c532-49e3-b174-a6525960210b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:16.888032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2cb4-c532-49e3-b174-a6525960210b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:16.907919 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-a29e2cb4-c532-49e3-b174-a6525960210b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:16.909205 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-a29e2cb4-c532-49e3-b174-a6525960210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:16.917733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 496/994] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:17.226730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6921-9a74-4b69-a8c1-bd9ad805027a None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:17.226730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6921-9a74-4b69-a8c1-bd9ad805027a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:17.226730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6921-9a74-4b69-a8c1-bd9ad805027a None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:17.228820 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 499/995] 10.222.0.18 () {54 vars in 964 bytes} [Mon Jul 25 21:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:17.233145 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:17.233383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:17.233745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:17.277567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] MFA Rules not processed for user `f785ecee24d24cd4941c744c4ad17a23`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:17.278796 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:17.295934 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c21b-a50b-47b0-bdfc-72fb014f610d None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:17.296722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c21b-a50b-47b0-bdfc-72fb014f610d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:17.297228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719c21b-a50b-47b0-bdfc-72fb014f610d None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:17.301315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 500/996] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:17.308127 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:17.308591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:17.308864 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:17.327890 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:17.329072 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:17.337257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 501/997] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:48:17.343065 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 497/998] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Jul 25 21:48:17 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:17.350311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:17.362363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0feff-69a4-4bcd-902d-8c75c9b20b60 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:17.366368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c0aa-0dae-4dd3-a4cc-a7bc5e8b13b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f785ecee24d24cd4941c744c4ad17a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:17.367015 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c0aa-0dae-4dd3-a4cc-a7bc5e8b13b6 service cinder] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:17.367299 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c0aa-0dae-4dd3-a4cc-a7bc5e8b13b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:17.367571 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c0aa-0dae-4dd3-a4cc-a7bc5e8b13b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:17.378802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c0aa-0dae-4dd3-a4cc-a7bc5e8b13b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:17.380299 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c0aa-0dae-4dd3-a4cc-a7bc5e8b13b6 service cinder] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:17.382738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:17.385062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:17.396484 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe716be-9934-4179-bffb-dc79b37205ce None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:17.399150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 498/999] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:48:17.401552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b837c22-1999-47cf-bb1c-6d32059def79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:17.402348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837c22-1999-47cf-bb1c-6d32059def79 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:17.402625 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837c22-1999-47cf-bb1c-6d32059def79 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:17.402894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837c22-1999-47cf-bb1c-6d32059def79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:17.411760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837c22-1999-47cf-bb1c-6d32059def79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:17.413581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837c22-1999-47cf-bb1c-6d32059def79 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:17.422899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 502/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:48:19.710969 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ac8d-d7da-43c1-95c5-d205858b3212 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:19.711496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ac8d-d7da-43c1-95c5-d205858b3212 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:19.711496 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7ac8d-d7da-43c1-95c5-d205858b3212 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:19.713131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 499/1001] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:19.718411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e93a0-c809-4751-9d86-a378cd73fd55 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:19.718863 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e93a0-c809-4751-9d86-a378cd73fd55 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:19.718987 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e93a0-c809-4751-9d86-a378cd73fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:19.738357 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-297e93a0-c809-4751-9d86-a378cd73fd55 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:19.739576 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-297e93a0-c809-4751-9d86-a378cd73fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:19.748272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 503/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:19.795349 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ac8d-d7da-43c1-95c5-d205858b3212 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:19.812295 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7ac8d-d7da-43c1-95c5-d205858b3212 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:19.818148 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e023f-e4b4-47b2-9391-cdd2161f9184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:19.818800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e023f-e4b4-47b2-9391-cdd2161f9184 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:19.819108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e023f-e4b4-47b2-9391-cdd2161f9184 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:19.819383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e023f-e4b4-47b2-9391-cdd2161f9184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:19.828335 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e023f-e4b4-47b2-9391-cdd2161f9184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:19.829931 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e023f-e4b4-47b2-9391-cdd2161f9184 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:19.840283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 500/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:22.164655 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1c20e-7be3-45c4-9c9b-2feaac26bb7e None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:22.165199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1c20e-7be3-45c4-9c9b-2feaac26bb7e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:22.165199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1c20e-7be3-45c4-9c9b-2feaac26bb7e None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:22.167026 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 504/1004] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:22.173214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05905a-59a5-48e7-bf74-a7f657e38175 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:22.173685 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05905a-59a5-48e7-bf74-a7f657e38175 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:22.174116 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05905a-59a5-48e7-bf74-a7f657e38175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:22.195281 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-bc05905a-59a5-48e7-bf74-a7f657e38175 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:22.196528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-bc05905a-59a5-48e7-bf74-a7f657e38175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:22.204536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 501/1005] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:22.249862 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1c20e-7be3-45c4-9c9b-2feaac26bb7e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:22.263565 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1c20e-7be3-45c4-9c9b-2feaac26bb7e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:22.268390 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a31fb-4b8d-42e7-8902-8db0b6c98c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:22.268999 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a31fb-4b8d-42e7-8902-8db0b6c98c49 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:22.269322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a31fb-4b8d-42e7-8902-8db0b6c98c49 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:22.269597 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a31fb-4b8d-42e7-8902-8db0b6c98c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:22.278132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a31fb-4b8d-42e7-8902-8db0b6c98c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:22.279751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a31fb-4b8d-42e7-8902-8db0b6c98c49 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:22.290121 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 505/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:24.589777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101269-7370-48ce-8304-9dd6ea7de4ee None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:24.590322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101269-7370-48ce-8304-9dd6ea7de4ee None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:24.590322 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06101269-7370-48ce-8304-9dd6ea7de4ee None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:24.591678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 502/1007] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:24.597041 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b30c-fb75-4eec-9f03-800e6dc7d8ff None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:24.597530 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b30c-fb75-4eec-9f03-800e6dc7d8ff None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:24.597877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b30c-fb75-4eec-9f03-800e6dc7d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:24.617549 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-26f2b30c-fb75-4eec-9f03-800e6dc7d8ff None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:24.618827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-26f2b30c-fb75-4eec-9f03-800e6dc7d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:24.626911 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 506/1008] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:24.672694 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101269-7370-48ce-8304-9dd6ea7de4ee None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:24.686452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06101269-7370-48ce-8304-9dd6ea7de4ee None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:24.692182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0d2b-8d81-4ae9-9a6d-5dabe629766b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:24.692800 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0d2b-8d81-4ae9-9a6d-5dabe629766b service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:24.693081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0d2b-8d81-4ae9-9a6d-5dabe629766b service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:24.693352 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0d2b-8d81-4ae9-9a6d-5dabe629766b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:24.702077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0d2b-8d81-4ae9-9a6d-5dabe629766b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:24.703679 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0d2b-8d81-4ae9-9a6d-5dabe629766b service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:24.713668 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 503/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:27.139515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d20121-b65b-413b-9a35-bccdd1eeb9c2 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:27.140071 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d20121-b65b-413b-9a35-bccdd1eeb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:27.140071 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d20121-b65b-413b-9a35-bccdd1eeb9c2 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:27.141415 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 507/1010] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:27.147541 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e222d-8e30-4cb0-952a-df7aefc6a80b None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:27.148042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e222d-8e30-4cb0-952a-df7aefc6a80b None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:27.148331 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e222d-8e30-4cb0-952a-df7aefc6a80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:27.173078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-aa3e222d-8e30-4cb0-952a-df7aefc6a80b None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:27.174639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-aa3e222d-8e30-4cb0-952a-df7aefc6a80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:27.185181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 504/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:27.232145 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d20121-b65b-413b-9a35-bccdd1eeb9c2 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:27.245385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d20121-b65b-413b-9a35-bccdd1eeb9c2 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:27.250438 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eef449-4372-4575-b499-9f1cdd873d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:27.251083 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef449-4372-4575-b499-9f1cdd873d67 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:27.251365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef449-4372-4575-b499-9f1cdd873d67 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:27.251665 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eef449-4372-4575-b499-9f1cdd873d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:27.260469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eef449-4372-4575-b499-9f1cdd873d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:27.262050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eef449-4372-4575-b499-9f1cdd873d67 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:27.271568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 508/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:30.272607 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed7dc-d245-4b5c-943e-123d5aa25aca None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:30.273374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed7dc-d245-4b5c-943e-123d5aa25aca None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:30.273374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed7dc-d245-4b5c-943e-123d5aa25aca None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:30.275049 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 505/1013] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:30.280396 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd170-0073-48b7-90b5-48001cd98202 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:30.280884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd170-0073-48b7-90b5-48001cd98202 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:30.281017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dd170-0073-48b7-90b5-48001cd98202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:30.303585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-fe3dd170-0073-48b7-90b5-48001cd98202 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:30.304962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-fe3dd170-0073-48b7-90b5-48001cd98202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:30.313825 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 509/1014] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:30.362311 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed7dc-d245-4b5c-943e-123d5aa25aca None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:30.379513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed7dc-d245-4b5c-943e-123d5aa25aca None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:30.385555 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c520ee-5734-4e7c-b6fa-c44e5ff5b4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:30.386370 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c520ee-5734-4e7c-b6fa-c44e5ff5b4ad service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:30.386729 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c520ee-5734-4e7c-b6fa-c44e5ff5b4ad service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:30.387214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c520ee-5734-4e7c-b6fa-c44e5ff5b4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:30.397262 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c520ee-5734-4e7c-b6fa-c44e5ff5b4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:30.399326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c520ee-5734-4e7c-b6fa-c44e5ff5b4ad service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:30.411627 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 506/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:33.074700 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b258007-2568-44df-bae2-96e3660523cb None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.097940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b258007-2568-44df-bae2-96e3660523cb None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.097940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b258007-2568-44df-bae2-96e3660523cb None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.097940 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 510/1016] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:33.098281 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd496-1cb4-40a4-b9fb-54f8bed345bb None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.098281 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd496-1cb4-40a4-b9fb-54f8bed345bb None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.098281 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd496-1cb4-40a4-b9fb-54f8bed345bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.105397 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-f97cd496-1cb4-40a4-b9fb-54f8bed345bb None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:33.106609 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-f97cd496-1cb4-40a4-b9fb-54f8bed345bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:33.114463 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 507/1017] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:33.158824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b258007-2568-44df-bae2-96e3660523cb None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:33.167028 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=49 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:33.173935 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b258007-2568-44df-bae2-96e3660523cb None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:33.178845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52714d20-37ee-4593-be6f-9678e0242779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:33.182180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52714d20-37ee-4593-be6f-9678e0242779 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.182462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52714d20-37ee-4593-be6f-9678e0242779 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.182734 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52714d20-37ee-4593-be6f-9678e0242779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.191846 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52714d20-37ee-4593-be6f-9678e0242779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:33.193459 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52714d20-37ee-4593-be6f-9678e0242779 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:33.202694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 511/1018] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:33.237853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177161c-de6d-4bb5-9a29-3f32c7df51b9 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.238129 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177161c-de6d-4bb5-9a29-3f32c7df51b9 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.238392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177161c-de6d-4bb5-9a29-3f32c7df51b9 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.239744 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 508/1019] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:33.245112 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8264c88-fd8b-43a6-b418-5fc0cc7d71ec None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.245426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8264c88-fd8b-43a6-b418-5fc0cc7d71ec None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.245706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8264c88-fd8b-43a6-b418-5fc0cc7d71ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.265033 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-a8264c88-fd8b-43a6-b418-5fc0cc7d71ec None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:33.279137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-a8264c88-fd8b-43a6-b418-5fc0cc7d71ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:33.279137 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 512/1020] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:33.333921 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfdc4a-28dd-4f32-a07e-8872e56b3a72 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.334149 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfdc4a-28dd-4f32-a07e-8872e56b3a72 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.334371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfdc4a-28dd-4f32-a07e-8872e56b3a72 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.335775 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 509/1021] 10.222.0.18 () {54 vars in 966 bytes} [Mon Jul 25 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:33.341518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e5c22-4f20-405f-b56a-0780ed405666 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.341800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e5c22-4f20-405f-b56a-0780ed405666 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.342301 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e5c22-4f20-405f-b56a-0780ed405666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.385147 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c27e5c22-4f20-405f-b56a-0780ed405666 None None] MFA Rules not processed for user `69b30a7d7bf84bf993efa9444b9a419f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:33.386365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c27e5c22-4f20-405f-b56a-0780ed405666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:33.450279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 513/1022] 10.222.0.18 () {58 vars in 1063 bytes} [Mon Jul 25 21:48:33 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:33.458351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfdc4a-28dd-4f32-a07e-8872e56b3a72 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:33.469294 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfdc4a-28dd-4f32-a07e-8872e56b3a72 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:33.472858 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb77a2-9a7f-4b55-8530-20cad66d62c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b30a7d7bf84bf993efa9444b9a419f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:33.473470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb77a2-9a7f-4b55-8530-20cad66d62c9 service glance] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:33.473748 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb77a2-9a7f-4b55-8530-20cad66d62c9 service glance] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:33.474024 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb77a2-9a7f-4b55-8530-20cad66d62c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:33.483188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb77a2-9a7f-4b55-8530-20cad66d62c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:33.484619 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb77a2-9a7f-4b55-8530-20cad66d62c9 service glance] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:33.494173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 510/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:35.477637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1cc4d-dbba-42ee-b30e-d5920c8b2169 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:35.478122 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1cc4d-dbba-42ee-b30e-d5920c8b2169 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:35.478226 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1cc4d-dbba-42ee-b30e-d5920c8b2169 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:35.479596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 514/1024] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:35.484960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5d85-331e-42fb-ad6b-af9232eda311 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:35.485472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5d85-331e-42fb-ad6b-af9232eda311 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:35.485472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5d85-331e-42fb-ad6b-af9232eda311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:35.505063 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-ce9f5d85-331e-42fb-ad6b-af9232eda311 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:35.506251 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-ce9f5d85-331e-42fb-ad6b-af9232eda311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:35.514081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 511/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:48:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:35.560425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1cc4d-dbba-42ee-b30e-d5920c8b2169 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:35.573724 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1cc4d-dbba-42ee-b30e-d5920c8b2169 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:35.578620 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20abe5-81b1-462b-a7dd-a57efdcf5495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:35.579402 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20abe5-81b1-462b-a7dd-a57efdcf5495 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:35.579690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20abe5-81b1-462b-a7dd-a57efdcf5495 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:35.579963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20abe5-81b1-462b-a7dd-a57efdcf5495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:35.588673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20abe5-81b1-462b-a7dd-a57efdcf5495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:35.590403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20abe5-81b1-462b-a7dd-a57efdcf5495 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:35.600830 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 515/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:45.500049 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=37 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:45.595912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=47 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:48.624883 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227244-8b6b-4d68-8a1a-9d19db6b0e29 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:48.625531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227244-8b6b-4d68-8a1a-9d19db6b0e29 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:48.625531 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227244-8b6b-4d68-8a1a-9d19db6b0e29 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:48.626778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 512/1027] 10.222.0.18 () {54 vars in 918 bytes} [Mon Jul 25 21:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:48.631790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8ecb8-1bc8-4876-af67-870440da1b28 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:48.632257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8ecb8-1bc8-4876-af67-870440da1b28 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:48.632360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8ecb8-1bc8-4876-af67-870440da1b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:48.652301 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-ccf8ecb8-1bc8-4876-af67-870440da1b28 None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:48.653491 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-ccf8ecb8-1bc8-4876-af67-870440da1b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:48.662672 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 516/1028] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jul 25 21:48:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:48.676781 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb71a-4895-4b55-a1fe-2a6bc7232e02 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:48.677095 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb71a-4895-4b55-a1fe-2a6bc7232e02 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:48.677392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eb71a-4895-4b55-a1fe-2a6bc7232e02 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:48.678735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 513/1029] 10.222.0.18 () {54 vars in 918 bytes} [Mon Jul 25 21:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:48.683264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53fe0-7186-40fe-bfe4-9ab06d145694 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:48.683531 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53fe0-7186-40fe-bfe4-9ab06d145694 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:48.683799 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53fe0-7186-40fe-bfe4-9ab06d145694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:48.702264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-a1c53fe0-7186-40fe-bfe4-9ab06d145694 None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:48.703568 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-a1c53fe0-7186-40fe-bfe4-9ab06d145694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:48.712224 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 517/1030] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jul 25 21:48:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:48:51.389299 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb89ec-f687-469f-9534-b154e3e638d4 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:51.389832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb89ec-f687-469f-9534-b154e3e638d4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:51.389832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb89ec-f687-469f-9534-b154e3e638d4 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:51.391211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:51.396804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8585-2ba6-4a28-a4d8-6ddc6d6e7d5d None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:51.397264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8585-2ba6-4a28-a4d8-6ddc6d6e7d5d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:51.397369 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8585-2ba6-4a28-a4d8-6ddc6d6e7d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:51.416062 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-13ee8585-2ba6-4a28-a4d8-6ddc6d6e7d5d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:51.417248 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-13ee8585-2ba6-4a28-a4d8-6ddc6d6e7d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:51.424790 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:48:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:48:51.469330 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb89ec-f687-469f-9534-b154e3e638d4 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:51.483320 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb89ec-f687-469f-9534-b154e3e638d4 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:51.488059 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798f30f-b1f0-4204-ae14-fe65e0fba4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:51.488651 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798f30f-b1f0-4204-ae14-fe65e0fba4cd service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:51.488923 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798f30f-b1f0-4204-ae14-fe65e0fba4cd service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:51.489192 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798f30f-b1f0-4204-ae14-fe65e0fba4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:51.497004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798f30f-b1f0-4204-ae14-fe65e0fba4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:51.498560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798f30f-b1f0-4204-ae14-fe65e0fba4cd service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:51.508142 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 515/1033] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:52.464702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740aa6f3-86a1-4f5a-83e7-78124a5af43a None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:52.465278 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740aa6f3-86a1-4f5a-83e7-78124a5af43a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:52.465381 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740aa6f3-86a1-4f5a-83e7-78124a5af43a None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:52.466691 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:52.471706 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6542-f084-4a40-a319-17926d76f286 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:52.472153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6542-f084-4a40-a319-17926d76f286 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:52.472291 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6542-f084-4a40-a319-17926d76f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:52.491608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-87dd6542-f084-4a40-a319-17926d76f286 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:52.492792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-87dd6542-f084-4a40-a319-17926d76f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:52.500629 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:52.713765 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740aa6f3-86a1-4f5a-83e7-78124a5af43a None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:52.727540 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740aa6f3-86a1-4f5a-83e7-78124a5af43a None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:52.732257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bdbce-702f-49da-8148-f06fe47d9436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:52.732855 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bdbce-702f-49da-8148-f06fe47d9436 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:52.733134 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bdbce-702f-49da-8148-f06fe47d9436 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:52.733408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bdbce-702f-49da-8148-f06fe47d9436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:52.741968 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bdbce-702f-49da-8148-f06fe47d9436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:52.743595 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bdbce-702f-49da-8148-f06fe47d9436 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:52.752750 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 520/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:53.641689 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c72083-7d1d-4c6e-8fe8-dd940a8fcc87 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:53.642229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c72083-7d1d-4c6e-8fe8-dd940a8fcc87 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:53.642229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c72083-7d1d-4c6e-8fe8-dd940a8fcc87 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:53.643522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:53.649038 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc3b8-5e7d-468f-9029-695df71ed476 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:53.649445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc3b8-5e7d-468f-9029-695df71ed476 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:53.649579 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc3b8-5e7d-468f-9029-695df71ed476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:53.668432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-bf0dc3b8-5e7d-468f-9029-695df71ed476 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:53.669603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-bf0dc3b8-5e7d-468f-9029-695df71ed476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:53.677158 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:53.833016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c72083-7d1d-4c6e-8fe8-dd940a8fcc87 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:53.846154 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c72083-7d1d-4c6e-8fe8-dd940a8fcc87 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:53.851268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d616b4b-7f74-4092-b9d8-d4e89f46453c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:53.851871 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d616b4b-7f74-4092-b9d8-d4e89f46453c service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:53.852151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d616b4b-7f74-4092-b9d8-d4e89f46453c service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:53.852449 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d616b4b-7f74-4092-b9d8-d4e89f46453c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:53.860611 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d616b4b-7f74-4092-b9d8-d4e89f46453c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:53.862183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d616b4b-7f74-4092-b9d8-d4e89f46453c service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:53.871858 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 518/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:54.739263 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a4bcb-2c4f-440c-92b2-599425fadef6 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:54.739795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a4bcb-2c4f-440c-92b2-599425fadef6 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:54.739795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a4bcb-2c4f-440c-92b2-599425fadef6 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:54.741066 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:54.745985 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1604-4a06-4f08-b46c-17000c88508c None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:54.746441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1604-4a06-4f08-b46c-17000c88508c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:54.746540 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1604-4a06-4f08-b46c-17000c88508c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:54.765927 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-827d1604-4a06-4f08-b46c-17000c88508c None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:54.767131 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-827d1604-4a06-4f08-b46c-17000c88508c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:54.774689 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:54.929764 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a4bcb-2c4f-440c-92b2-599425fadef6 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:54.943938 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a4bcb-2c4f-440c-92b2-599425fadef6 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:54.949477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7d454-3ca3-4478-8c4c-c86b7b05955b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:54.950134 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d454-3ca3-4478-8c4c-c86b7b05955b service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:54.950412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d454-3ca3-4478-8c4c-c86b7b05955b service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:54.950678 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d454-3ca3-4478-8c4c-c86b7b05955b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:54.959508 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7d454-3ca3-4478-8c4c-c86b7b05955b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:54.961128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7d454-3ca3-4478-8c4c-c86b7b05955b service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:54.971307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 523/1042] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:55.836689 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd30fe-9c26-4cd3-a1a5-5652d1d80a52 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:55.837264 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd30fe-9c26-4cd3-a1a5-5652d1d80a52 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:55.837264 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd30fe-9c26-4cd3-a1a5-5652d1d80a52 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:55.838578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:55.843551 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad07d4-a1b3-4503-b575-c274d0e74846 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:55.843982 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad07d4-a1b3-4503-b575-c274d0e74846 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:55.844116 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad07d4-a1b3-4503-b575-c274d0e74846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:55.863918 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-89ad07d4-a1b3-4503-b575-c274d0e74846 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:55.865083 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-89ad07d4-a1b3-4503-b575-c274d0e74846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:55.872644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:56.035189 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd30fe-9c26-4cd3-a1a5-5652d1d80a52 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:56.048567 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd30fe-9c26-4cd3-a1a5-5652d1d80a52 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:56.054083 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad388d-f395-4ff6-877b-2e9864137cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:56.054683 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad388d-f395-4ff6-877b-2e9864137cd6 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:56.054996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad388d-f395-4ff6-877b-2e9864137cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:56.055274 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad388d-f395-4ff6-877b-2e9864137cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:56.063286 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad388d-f395-4ff6-877b-2e9864137cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:56.064860 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad388d-f395-4ff6-877b-2e9864137cd6 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:56.074242 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 521/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:56.886395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc920f8-e263-4a95-a499-7af3ad65bb56 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:56.886954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc920f8-e263-4a95-a499-7af3ad65bb56 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:56.886954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc920f8-e263-4a95-a499-7af3ad65bb56 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:56.888222 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:56.893158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc894f0-0194-4e03-9689-2ebff3d3650d None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:56.893584 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc894f0-0194-4e03-9689-2ebff3d3650d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:56.893686 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc894f0-0194-4e03-9689-2ebff3d3650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:56.913785 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-1bc894f0-0194-4e03-9689-2ebff3d3650d None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:56.915125 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-1bc894f0-0194-4e03-9689-2ebff3d3650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:56.922766 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:57.076923 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc920f8-e263-4a95-a499-7af3ad65bb56 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:57.090412 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc920f8-e263-4a95-a499-7af3ad65bb56 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:57.095210 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b3fc6-9b4d-4388-a861-6009200f5eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:57.095811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b3fc6-9b4d-4388-a861-6009200f5eac service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:57.096091 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b3fc6-9b4d-4388-a861-6009200f5eac service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:57.096361 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b3fc6-9b4d-4388-a861-6009200f5eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:57.104834 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b3fc6-9b4d-4388-a861-6009200f5eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:57.106406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b3fc6-9b4d-4388-a861-6009200f5eac service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:57.115492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 526/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:57.919846 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fecee-c8bb-4025-8e23-11c0e849e2ea None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:57.920383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fecee-c8bb-4025-8e23-11c0e849e2ea None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:57.920383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fecee-c8bb-4025-8e23-11c0e849e2ea None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:57.921658 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:57.927244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0490-07ea-4961-b990-2c4d8026e177 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:57.927687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0490-07ea-4961-b990-2c4d8026e177 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:57.927786 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0490-07ea-4961-b990-2c4d8026e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:57.947094 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-18ca0490-07ea-4961-b990-2c4d8026e177 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:57.948283 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-18ca0490-07ea-4961-b990-2c4d8026e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:57.956023 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:58.116639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fecee-c8bb-4025-8e23-11c0e849e2ea None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:58.129904 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fecee-c8bb-4025-8e23-11c0e849e2ea None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:58.134739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e58b3-b556-483b-a7ea-5a8dc56ab6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:58.135376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e58b3-b556-483b-a7ea-5a8dc56ab6e2 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:58.135654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e58b3-b556-483b-a7ea-5a8dc56ab6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:58.135920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e58b3-b556-483b-a7ea-5a8dc56ab6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:58.143852 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e58b3-b556-483b-a7ea-5a8dc56ab6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:58.145416 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e58b3-b556-483b-a7ea-5a8dc56ab6e2 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:58.155021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 524/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:58.963057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9113d-92c3-47ef-9a4c-74e11bc5f4e3 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:58.963601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9113d-92c3-47ef-9a4c-74e11bc5f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:58.963601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9113d-92c3-47ef-9a4c-74e11bc5f4e3 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:58.964943 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:48:58.969741 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924620ee-7b80-49cb-808f-6b5bb9f48d7c None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:58.970117 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924620ee-7b80-49cb-808f-6b5bb9f48d7c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:58.970292 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924620ee-7b80-49cb-808f-6b5bb9f48d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:58.990246 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-924620ee-7b80-49cb-808f-6b5bb9f48d7c None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:58.991441 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-924620ee-7b80-49cb-808f-6b5bb9f48d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:58.999178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:59.155618 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9113d-92c3-47ef-9a4c-74e11bc5f4e3 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:59.169505 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9113d-92c3-47ef-9a4c-74e11bc5f4e3 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:59.174287 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f803a3-9a50-4c15-a236-eb152abc0262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:59.174888 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f803a3-9a50-4c15-a236-eb152abc0262 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.175216 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f803a3-9a50-4c15-a236-eb152abc0262 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.175486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f803a3-9a50-4c15-a236-eb152abc0262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:59.183348 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f803a3-9a50-4c15-a236-eb152abc0262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:59.184914 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f803a3-9a50-4c15-a236-eb152abc0262 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:59.194016 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 529/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:59.991763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719b6f-1eae-47c8-9b1b-9cad44abeabc None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.992306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719b6f-1eae-47c8-9b1b-9cad44abeabc None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.992306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719b6f-1eae-47c8-9b1b-9cad44abeabc None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:59.993650 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:48:59.998489 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56b6f-a794-47dc-b2e9-accab7e050a3 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.998971 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56b6f-a794-47dc-b2e9-accab7e050a3 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.999075 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56b6f-a794-47dc-b2e9-accab7e050a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:00.017856 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-50d56b6f-a794-47dc-b2e9-accab7e050a3 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:00.019570 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-50d56b6f-a794-47dc-b2e9-accab7e050a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:00.027250 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:48:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:00.182153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719b6f-1eae-47c8-9b1b-9cad44abeabc None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:00.195635 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719b6f-1eae-47c8-9b1b-9cad44abeabc None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:00.200351 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6482636-3c2b-48f9-acb3-e481e81afd50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:00.200941 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482636-3c2b-48f9-acb3-e481e81afd50 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:00.201214 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482636-3c2b-48f9-acb3-e481e81afd50 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:00.201483 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6482636-3c2b-48f9-acb3-e481e81afd50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:00.209829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6482636-3c2b-48f9-acb3-e481e81afd50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:00.211434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6482636-3c2b-48f9-acb3-e481e81afd50 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:00.220428 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 527/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:02.347946 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52536bb-946b-4b66-9125-1047048b3aa1 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:02.348497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52536bb-946b-4b66-9125-1047048b3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:02.348497 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52536bb-946b-4b66-9125-1047048b3aa1 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:02.349826 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:02.355002 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079bfa-1d21-4368-b980-6828133a2075 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:02.355415 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079bfa-1d21-4368-b980-6828133a2075 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:02.355554 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079bfa-1d21-4368-b980-6828133a2075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:02.374654 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-33079bfa-1d21-4368-b980-6828133a2075 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:02.375879 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-33079bfa-1d21-4368-b980-6828133a2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:02.384094 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:02.426733 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52536bb-946b-4b66-9125-1047048b3aa1 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:02.437171 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52536bb-946b-4b66-9125-1047048b3aa1 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:02.440656 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba30eb-2244-4fff-9795-0871552b4113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:02.441258 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba30eb-2244-4fff-9795-0871552b4113 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:02.441539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba30eb-2244-4fff-9795-0871552b4113 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:02.441813 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba30eb-2244-4fff-9795-0871552b4113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:02.450464 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba30eb-2244-4fff-9795-0871552b4113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:02.452039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba30eb-2244-4fff-9795-0871552b4113 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:02.461237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 532/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:04.802120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1b2b-c526-4a46-9ab9-e02fd3fd770f None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:04.802634 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1b2b-c526-4a46-9ab9-e02fd3fd770f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:04.802634 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1b2b-c526-4a46-9ab9-e02fd3fd770f None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:04.803933 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:04.809163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1bc3c-c76a-4af8-b7f3-cfda80cf3dba None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:04.809594 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1bc3c-c76a-4af8-b7f3-cfda80cf3dba None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:04.809706 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1bc3c-c76a-4af8-b7f3-cfda80cf3dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:04.828104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-c8d1bc3c-c76a-4af8-b7f3-cfda80cf3dba None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:04.829315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c8d1bc3c-c76a-4af8-b7f3-cfda80cf3dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:04.836837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:04.876096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1b2b-c526-4a46-9ab9-e02fd3fd770f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:04.886689 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1b2b-c526-4a46-9ab9-e02fd3fd770f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:04.890178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a675e9-1247-4e46-acb0-54f2af925287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:04.890782 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a675e9-1247-4e46-acb0-54f2af925287 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:04.891096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a675e9-1247-4e46-acb0-54f2af925287 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:04.891369 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a675e9-1247-4e46-acb0-54f2af925287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:04.900445 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a675e9-1247-4e46-acb0-54f2af925287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:04.901872 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a675e9-1247-4e46-acb0-54f2af925287 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:04.911752 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 530/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:07.481896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b782b-33b2-4b17-94b4-0c76e20e9e8c None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:07.482322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b782b-33b2-4b17-94b4-0c76e20e9e8c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:07.482445 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b782b-33b2-4b17-94b4-0c76e20e9e8c None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:07.483837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:49:07.489461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5849a-b24d-4f51-8cf5-734b59d76795 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:07.489876 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5849a-b24d-4f51-8cf5-734b59d76795 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:07.490009 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5849a-b24d-4f51-8cf5-734b59d76795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:07.509234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-91f5849a-b24d-4f51-8cf5-734b59d76795 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:07.510423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-91f5849a-b24d-4f51-8cf5-734b59d76795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:07.518088 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:07.558163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b782b-33b2-4b17-94b4-0c76e20e9e8c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:07.569120 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b782b-33b2-4b17-94b4-0c76e20e9e8c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:07.572564 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d7c12-3f3d-4368-82b5-72e916d7a240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:07.573166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d7c12-3f3d-4368-82b5-72e916d7a240 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:07.573439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d7c12-3f3d-4368-82b5-72e916d7a240 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:07.573707 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d7c12-3f3d-4368-82b5-72e916d7a240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:07.582294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d7c12-3f3d-4368-82b5-72e916d7a240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:07.583738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d7c12-3f3d-4368-82b5-72e916d7a240 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:07.592770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 535/1066] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:09.906314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5219441-f52f-465a-9263-dd836e12f03a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:09.906889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5219441-f52f-465a-9263-dd836e12f03a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:09.906889 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5219441-f52f-465a-9263-dd836e12f03a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:09.908284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:09.914323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3316-295c-41d0-8f10-3f5139c72d76 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:09.914870 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3316-295c-41d0-8f10-3f5139c72d76 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:09.914996 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f3316-295c-41d0-8f10-3f5139c72d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:09.934166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-635f3316-295c-41d0-8f10-3f5139c72d76 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:09.935406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-635f3316-295c-41d0-8f10-3f5139c72d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:09.943674 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:09.983306 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5219441-f52f-465a-9263-dd836e12f03a None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:09.994275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5219441-f52f-465a-9263-dd836e12f03a None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:09.997796 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9988eb5-ff2b-44de-9355-3779cb71cbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:09.998423 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9988eb5-ff2b-44de-9355-3779cb71cbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:09.998725 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9988eb5-ff2b-44de-9355-3779cb71cbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:09.999027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9988eb5-ff2b-44de-9355-3779cb71cbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:10.009955 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9988eb5-ff2b-44de-9355-3779cb71cbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:10.011442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9988eb5-ff2b-44de-9355-3779cb71cbd3 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:10.023486 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 533/1069] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:12.329869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746ed4e-7674-4eb8-97b7-2dbac5ff27f9 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:12.330440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746ed4e-7674-4eb8-97b7-2dbac5ff27f9 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:12.330440 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746ed4e-7674-4eb8-97b7-2dbac5ff27f9 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:12.331894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:12.337228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ad4f-70ca-4343-8490-9d04f78d0ca3 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:12.337655 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ad4f-70ca-4343-8490-9d04f78d0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:12.337765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355ad4f-70ca-4343-8490-9d04f78d0ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:12.357548 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-e355ad4f-70ca-4343-8490-9d04f78d0ca3 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:12.358722 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e355ad4f-70ca-4343-8490-9d04f78d0ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:12.367104 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:12.405337 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746ed4e-7674-4eb8-97b7-2dbac5ff27f9 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:12.416353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746ed4e-7674-4eb8-97b7-2dbac5ff27f9 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:12.419736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977ec56-1224-44ed-9dbf-c8e64c37eadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:12.420330 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977ec56-1224-44ed-9dbf-c8e64c37eadf service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:12.420604 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977ec56-1224-44ed-9dbf-c8e64c37eadf service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:12.420875 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977ec56-1224-44ed-9dbf-c8e64c37eadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:12.429646 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977ec56-1224-44ed-9dbf-c8e64c37eadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:12.431154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977ec56-1224-44ed-9dbf-c8e64c37eadf service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:12.440853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 538/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:14.708179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d9a3-3960-4a4e-9547-35d2736bb2cf None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:14.708718 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d9a3-3960-4a4e-9547-35d2736bb2cf None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:14.708718 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d9a3-3960-4a4e-9547-35d2736bb2cf None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:14.710042 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:14.715175 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561819-0756-4d91-89b1-8346912b5e70 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:14.715608 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561819-0756-4d91-89b1-8346912b5e70 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:14.715721 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561819-0756-4d91-89b1-8346912b5e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:14.735078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-7f561819-0756-4d91-89b1-8346912b5e70 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:14.736196 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-7f561819-0756-4d91-89b1-8346912b5e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:14.744636 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:14.782893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d9a3-3960-4a4e-9547-35d2736bb2cf None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:14.793968 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d9a3-3960-4a4e-9547-35d2736bb2cf None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:14.797366 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433137e7-27b5-45fc-b01d-9df4d8ab0a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:14.797957 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433137e7-27b5-45fc-b01d-9df4d8ab0a54 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:14.798228 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433137e7-27b5-45fc-b01d-9df4d8ab0a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:14.798493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433137e7-27b5-45fc-b01d-9df4d8ab0a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:14.807700 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433137e7-27b5-45fc-b01d-9df4d8ab0a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:14.809109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433137e7-27b5-45fc-b01d-9df4d8ab0a54 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:14.818146 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 536/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:17.106644 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8cb5-bbb2-4a3c-8467-abaaf59128cd None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:17.107240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8cb5-bbb2-4a3c-8467-abaaf59128cd None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:17.107240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8cb5-bbb2-4a3c-8467-abaaf59128cd None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:17.108575 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:17.113712 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66b78-9c55-41ba-9c14-9d0485e779ae None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:17.114091 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66b78-9c55-41ba-9c14-9d0485e779ae None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:17.114260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66b78-9c55-41ba-9c14-9d0485e779ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:17.121762 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=70 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:49:17.134227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-5af66b78-9c55-41ba-9c14-9d0485e779ae None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:17.135451 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-5af66b78-9c55-41ba-9c14-9d0485e779ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:17.143715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:17.183488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec8cb5-bbb2-4a3c-8467-abaaf59128cd None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:17.188763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=73 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:49:17.194863 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec8cb5-bbb2-4a3c-8467-abaaf59128cd None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:17.198292 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777839f3-74bd-4aba-aa02-f88cd73f78c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:17.198894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777839f3-74bd-4aba-aa02-f88cd73f78c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:17.199199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777839f3-74bd-4aba-aa02-f88cd73f78c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:17.199468 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777839f3-74bd-4aba-aa02-f88cd73f78c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:17.208543 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777839f3-74bd-4aba-aa02-f88cd73f78c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:17.209961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777839f3-74bd-4aba-aa02-f88cd73f78c7 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:17.218991 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 541/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:19.479008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054e93-e97d-4aaa-b503-5c0ba8b0f072 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:19.479468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054e93-e97d-4aaa-b503-5c0ba8b0f072 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:19.479589 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054e93-e97d-4aaa-b503-5c0ba8b0f072 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:19.480944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:19.485947 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a40cf-d568-4ef9-ad85-95680650fa25 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:19.486369 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a40cf-d568-4ef9-ad85-95680650fa25 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:19.486474 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a40cf-d568-4ef9-ad85-95680650fa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:19.506614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-001a40cf-d568-4ef9-ad85-95680650fa25 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:19.507810 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-001a40cf-d568-4ef9-ad85-95680650fa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:19.515318 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:19.553208 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054e93-e97d-4aaa-b503-5c0ba8b0f072 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:19.563746 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054e93-e97d-4aaa-b503-5c0ba8b0f072 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:19.567826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4eb08-df01-42ba-97ec-4a1860902ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:19.568421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4eb08-df01-42ba-97ec-4a1860902ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:19.568696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4eb08-df01-42ba-97ec-4a1860902ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:19.568963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4eb08-df01-42ba-97ec-4a1860902ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:19.577537 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4eb08-df01-42ba-97ec-4a1860902ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:19.578973 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4eb08-df01-42ba-97ec-4a1860902ec0 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:19.588133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 539/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:21.821130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780040b-6455-427c-94a6-5a7d64d1e669 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:21.821712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780040b-6455-427c-94a6-5a7d64d1e669 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:21.821712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780040b-6455-427c-94a6-5a7d64d1e669 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:21.823053 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:21.828122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a43e32-036c-4068-b90f-d9c0b63b1ce1 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:21.828570 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a43e32-036c-4068-b90f-d9c0b63b1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:21.828695 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a43e32-036c-4068-b90f-d9c0b63b1ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:21.847368 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-69a43e32-036c-4068-b90f-d9c0b63b1ce1 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:21.848566 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-69a43e32-036c-4068-b90f-d9c0b63b1ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:21.856482 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:21.895101 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780040b-6455-427c-94a6-5a7d64d1e669 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:21.905839 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780040b-6455-427c-94a6-5a7d64d1e669 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:21.909787 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491acd-2460-4a5d-a019-34b562ce7e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:21.910392 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491acd-2460-4a5d-a019-34b562ce7e2b service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:21.910671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491acd-2460-4a5d-a019-34b562ce7e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:21.910984 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491acd-2460-4a5d-a019-34b562ce7e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:21.920043 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3491acd-2460-4a5d-a019-34b562ce7e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:21.921467 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3491acd-2460-4a5d-a019-34b562ce7e2b service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:21.931963 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 544/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:24.137221 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf6cc-4221-48a7-81c9-eb4e5e0d0835 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:24.137802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf6cc-4221-48a7-81c9-eb4e5e0d0835 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:24.137802 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf6cc-4221-48a7-81c9-eb4e5e0d0835 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:24.139132 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:24.144722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055245-bc0e-4a24-95c0-3efd9ea6fc7a None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:24.145128 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055245-bc0e-4a24-95c0-3efd9ea6fc7a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:24.145324 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5055245-bc0e-4a24-95c0-3efd9ea6fc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:24.164800 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-d5055245-bc0e-4a24-95c0-3efd9ea6fc7a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:24.165961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-d5055245-bc0e-4a24-95c0-3efd9ea6fc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:24.173480 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:49:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:49:24.212027 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf6cc-4221-48a7-81c9-eb4e5e0d0835 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:24.222523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf6cc-4221-48a7-81c9-eb4e5e0d0835 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:24.226016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fff08-dc03-49c7-9758-af762e908793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:24.226612 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fff08-dc03-49c7-9758-af762e908793 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:24.226891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fff08-dc03-49c7-9758-af762e908793 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:24.227193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fff08-dc03-49c7-9758-af762e908793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:24.235875 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fff08-dc03-49c7-9758-af762e908793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:24.237295 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fff08-dc03-49c7-9758-af762e908793 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:24.246647 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 542/1087] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:34.159762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=17 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:49:34.242401 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=17 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:49:47.596811 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32375d-8127-4888-bd43-d39f17f112ca None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:47.597371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32375d-8127-4888-bd43-d39f17f112ca None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:47.597371 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32375d-8127-4888-bd43-d39f17f112ca None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:47.598703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 546/1088] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:47.603882 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3069-c810-466d-8cf4-f9d5193ef981 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:47.604287 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3069-c810-466d-8cf4-f9d5193ef981 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:47.604422 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3069-c810-466d-8cf4-f9d5193ef981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:47.623550 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-738a3069-c810-466d-8cf4-f9d5193ef981 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:47.624650 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-738a3069-c810-466d-8cf4-f9d5193ef981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:47.632314 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 543/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:49:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:47.681354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4491e80-5637-44c5-bff3-d749ae98f807 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:47.681634 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4491e80-5637-44c5-bff3-d749ae98f807 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:47.681908 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4491e80-5637-44c5-bff3-d749ae98f807 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:47.683292 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 547/1090] 10.222.0.18 () {54 vars in 966 bytes} [Mon Jul 25 21:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:47.688438 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a577-7760-4149-83bb-9a82c6cc7e6d None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:47.688752 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a577-7760-4149-83bb-9a82c6cc7e6d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:47.689021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a577-7760-4149-83bb-9a82c6cc7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:47.707733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d722a577-7760-4149-83bb-9a82c6cc7e6d None None] MFA Rules not processed for user `69b30a7d7bf84bf993efa9444b9a419f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:47.708887 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d722a577-7760-4149-83bb-9a82c6cc7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:47.715133 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 544/1091] 10.222.0.18 () {58 vars in 1063 bytes} [Mon Jul 25 21:49:47 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:47.722892 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4491e80-5637-44c5-bff3-d749ae98f807 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:47.733424 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4491e80-5637-44c5-bff3-d749ae98f807 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:47.737571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc80c21-fd80-4a39-8d8e-c3daf0194b75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b30a7d7bf84bf993efa9444b9a419f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:47.738195 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc80c21-fd80-4a39-8d8e-c3daf0194b75 service glance] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:47.738471 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc80c21-fd80-4a39-8d8e-c3daf0194b75 service glance] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:47.738740 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc80c21-fd80-4a39-8d8e-c3daf0194b75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:47.747499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc80c21-fd80-4a39-8d8e-c3daf0194b75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:47.748915 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc80c21-fd80-4a39-8d8e-c3daf0194b75 service glance] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:47.758186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 548/1092] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:49:50.113986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390017c6-38cf-4209-9ef9-736badc4dc80 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:50.114643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390017c6-38cf-4209-9ef9-736badc4dc80 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:50.114643 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390017c6-38cf-4209-9ef9-736badc4dc80 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:50.115936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 545/1093] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:50.121160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca5ff-86c0-4a1e-8216-6f0fb849576a None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:50.121586 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca5ff-86c0-4a1e-8216-6f0fb849576a None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:50.121778 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceca5ff-86c0-4a1e-8216-6f0fb849576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:50.140115 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-0ceca5ff-86c0-4a1e-8216-6f0fb849576a None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:50.141272 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-0ceca5ff-86c0-4a1e-8216-6f0fb849576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:50.149342 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 549/1094] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:49:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:50.173558 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390017c6-38cf-4209-9ef9-736badc4dc80 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:50.185903 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390017c6-38cf-4209-9ef9-736badc4dc80 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:50.190301 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:50.190894 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:50.191207 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:50.191478 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:50.192163 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:50.193901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:49:50.193901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:49:50.193901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:49:50.195070 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbb7b2-347f-478c-988e-426d912dfa26 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:50.213008 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 546/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Jul 25 21:49:50 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:49:53.056339 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71013fb-aec4-440a-9e4c-3d5854d325b6 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:53.056912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71013fb-aec4-440a-9e4c-3d5854d325b6 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:53.056912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71013fb-aec4-440a-9e4c-3d5854d325b6 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:53.058204 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 550/1096] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:53.063418 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450101c-b9f1-4332-b8f5-93f46c5b8880 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:53.064410 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450101c-b9f1-4332-b8f5-93f46c5b8880 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:53.064625 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450101c-b9f1-4332-b8f5-93f46c5b8880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:53.083670 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-f450101c-b9f1-4332-b8f5-93f46c5b8880 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:53.084862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-f450101c-b9f1-4332-b8f5-93f46c5b8880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:53.092579 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 547/1097] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:49:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:53.136894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71013fb-aec4-440a-9e4c-3d5854d325b6 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:53.150441 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71013fb-aec4-440a-9e4c-3d5854d325b6 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:53.156355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bcb39-b109-4889-8c62-b9671e8f9943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:53.156959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcb39-b109-4889-8c62-b9671e8f9943 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:53.157240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcb39-b109-4889-8c62-b9671e8f9943 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:53.157511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bcb39-b109-4889-8c62-b9671e8f9943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:53.165783 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bcb39-b109-4889-8c62-b9671e8f9943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:53.167406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bcb39-b109-4889-8c62-b9671e8f9943 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:53.177499 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 551/1098] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:55.611234 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bee95e-1a6e-47e7-bebe-56847ad1b160 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:55.611792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bee95e-1a6e-47e7-bebe-56847ad1b160 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:55.611792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bee95e-1a6e-47e7-bebe-56847ad1b160 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:55.613016 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 548/1099] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:55.618136 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607bc79-cd51-4a96-b3b9-9cb4df6a7180 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:55.618537 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607bc79-cd51-4a96-b3b9-9cb4df6a7180 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:55.618685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607bc79-cd51-4a96-b3b9-9cb4df6a7180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:55.637244 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-f607bc79-cd51-4a96-b3b9-9cb4df6a7180 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:55.638430 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-f607bc79-cd51-4a96-b3b9-9cb4df6a7180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:55.646614 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 552/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:49:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:55.683568 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bee95e-1a6e-47e7-bebe-56847ad1b160 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:55.694703 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bee95e-1a6e-47e7-bebe-56847ad1b160 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:55.698158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5d898-3ec9-4de3-ae8d-035da84dd33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:55.698760 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5d898-3ec9-4de3-ae8d-035da84dd33a service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:55.699081 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5d898-3ec9-4de3-ae8d-035da84dd33a service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:55.699358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5d898-3ec9-4de3-ae8d-035da84dd33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:55.710107 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5d898-3ec9-4de3-ae8d-035da84dd33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:55.711584 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5d898-3ec9-4de3-ae8d-035da84dd33a service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:55.720997 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 549/1101] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:57.997240 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d628-58c8-47e9-9852-d908a5245b5e None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:57.997828 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d628-58c8-47e9-9852-d908a5245b5e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:57.997828 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2d628-58c8-47e9-9852-d908a5245b5e None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:57.999163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 553/1102] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:49:58.004798 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb16ba-a80b-49f3-bb98-9c84e98728ed None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:58.005264 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb16ba-a80b-49f3-bb98-9c84e98728ed None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:58.005369 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb16ba-a80b-49f3-bb98-9c84e98728ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:58.025151 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-98bb16ba-a80b-49f3-bb98-9c84e98728ed None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:58.026529 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-98bb16ba-a80b-49f3-bb98-9c84e98728ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:58.034376 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 550/1103] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:49:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:58.073229 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d628-58c8-47e9-9852-d908a5245b5e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:58.084355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2d628-58c8-47e9-9852-d908a5245b5e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:58.087794 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa2232-aef2-4094-bd81-5d19612dc9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:58.088398 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa2232-aef2-4094-bd81-5d19612dc9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:58.088675 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa2232-aef2-4094-bd81-5d19612dc9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:58.088946 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa2232-aef2-4094-bd81-5d19612dc9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:58.097752 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa2232-aef2-4094-bd81-5d19612dc9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:58.099225 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa2232-aef2-4094-bd81-5d19612dc9a6 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:58.108360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 554/1104] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:50:00.437252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7fde8-fd91-433b-ab2b-e343bc1e351f None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:50:00.437842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7fde8-fd91-433b-ab2b-e343bc1e351f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:50:00.437842 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7fde8-fd91-433b-ab2b-e343bc1e351f None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:50:00.439182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 551/1105] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:50:00.444333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0a6b4-b6d3-4083-98eb-ba4f720f801e None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:50:00.444736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0a6b4-b6d3-4083-98eb-ba4f720f801e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:50:00.444912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0a6b4-b6d3-4083-98eb-ba4f720f801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:50:00.463671 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-86c0a6b4-b6d3-4083-98eb-ba4f720f801e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:50:00.464874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-86c0a6b4-b6d3-4083-98eb-ba4f720f801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:50:00.473177 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 555/1106] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:50:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:50:00.513914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7fde8-fd91-433b-ab2b-e343bc1e351f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:50:00.524352 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7fde8-fd91-433b-ab2b-e343bc1e351f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:50:00.527780 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65151c50-11cf-4beb-8f53-6f1830ba32b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:50:00.528380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151c50-11cf-4beb-8f53-6f1830ba32b7 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:50:00.528658 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151c50-11cf-4beb-8f53-6f1830ba32b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:50:00.528929 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65151c50-11cf-4beb-8f53-6f1830ba32b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:50:00.538317 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65151c50-11cf-4beb-8f53-6f1830ba32b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:50:00.539777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65151c50-11cf-4beb-8f53-6f1830ba32b7 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:50:00.549525 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 552/1107] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:50:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:50:03.095180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0fedc-4109-41bc-a7e8-361d8c8ec56d None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:50:03.095762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0fedc-4109-41bc-a7e8-361d8c8ec56d None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:50:03.095762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0fedc-4109-41bc-a7e8-361d8c8ec56d None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:50:03.097064 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 556/1108] 10.222.0.18 () {54 vars in 926 bytes} [Mon Jul 25 21:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:50:03.102128 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b579-c43f-4095-abc4-2e0176079774 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:50:03.102572 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b579-c43f-4095-abc4-2e0176079774 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:50:03.102709 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b579-c43f-4095-abc4-2e0176079774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:50:03.121178 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c106b579-c43f-4095-abc4-2e0176079774 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:50:03.122361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c106b579-c43f-4095-abc4-2e0176079774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:50:03.129986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 553/1109] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Jul 25 21:50:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:50:03.170673 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0fedc-4109-41bc-a7e8-361d8c8ec56d None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:50:03.181081 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0fedc-4109-41bc-a7e8-361d8c8ec56d None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:50:03.184546 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58ed07-2e3b-4452-a99d-6a2202b12746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:50:03.185148 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58ed07-2e3b-4452-a99d-6a2202b12746 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:50:03.185422 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58ed07-2e3b-4452-a99d-6a2202b12746 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:50:03.185687 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58ed07-2e3b-4452-a99d-6a2202b12746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:50:03.194807 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58ed07-2e3b-4452-a99d-6a2202b12746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:50:03.196257 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58ed07-2e3b-4452-a99d-6a2202b12746 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:50:03.205931 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 557/1110] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:50:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:50:13.116578 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=33 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:50:13.201333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=33 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:35.988678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:35.989309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:35.989309 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.008092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:36.009289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:36.017536 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 554/1111] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:51:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:51:36.025513 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.026014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.026126 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.045809 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:36.047039 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:36.054660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 558/1112] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:51:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:51:36.059161 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.068941 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bc8a-85b7-4ab8-96be-72d5f0f49220 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.073449 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.074052 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.074332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.074606 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.075324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:51:36.076137 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.077150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.077150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:51:36.077150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:51:36.078033 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.089229 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 555/1113] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 21:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:51:36.097820 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.106711 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d222c2-c696-4813-a89a-10df80c2e7c4 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.111253 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.111854 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.112130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.112400 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.113050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.115113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.115113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 21:51:36.115113 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 21:51:36.116318 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.142931 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 559/1114] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 21:51:36 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:51:36.146987 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.156818 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223731a-d9d0-47d7-ab33-13d21470ad0b admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.211336 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.211945 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.212226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.212498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.213159 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.214173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.214173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:51:36.214173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:51:36.215410 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.237468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 556/1115] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:51:36 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:51:36.241680 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.251827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52246a5-0d11-477c-a242-954b23338a6f admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.256390 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.257001 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.257280 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.257550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.258233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.259309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.259309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 21:51:36.259309 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 21:51:36.260186 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.272536 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 560/1116] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:51:36.276265 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.286388 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe03dc-5280-44c5-994f-2a8330c9292a admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.291252 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.291853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.292134 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.292408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.293086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.294087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.294087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:51:36.294087 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:51:36.295612 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34325887-b3c2-4aa6-9b55-b6bafb14499e admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.308556 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 557/1117] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:51:36.312997 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.322848 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8698-1513-4dba-9e29-8af7bf328d92 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.328217 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.328869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.329145 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.329425 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] PATH_INFO: `/v3/projects/55fce512468c42898a301232689aa12d/users/f4f335d4516644a7b53e8c6ca55f1b42/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.343592 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fce512468c42898a301232689aa12d, user_id=f4f335d4516644a7b53e8c6ca55f1b42, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.344607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.344607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 21:51:36.344607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 21:51:36.346542 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c428f2-6332-4bfe-97a0-04f197cc6a13 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.358894 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 561/1118] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:51:36 2022] PUT /identity/v3/projects/55fce512468c42898a301232689aa12d/users/f4f335d4516644a7b53e8c6ca55f1b42/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:51:36.370784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752b27-136c-402c-a000-a220638d9288 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.371101 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752b27-136c-402c-a000-a220638d9288 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.371378 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752b27-136c-402c-a000-a220638d9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.399427 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0d752b27-136c-402c-a000-a220638d9288 None None] MFA Rules not processed for user `f4f335d4516644a7b53e8c6ca55f1b42`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:36.400617 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0d752b27-136c-402c-a000-a220638d9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:36.462173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 558/1119] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:51:36 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:51:36.476096 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f75f5-8d34-4e4d-a7ab-dc08fc983d51 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.476385 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f75f5-8d34-4e4d-a7ab-dc08fc983d51 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.476662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f75f5-8d34-4e4d-a7ab-dc08fc983d51 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.478294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 562/1120] 10.222.0.18 () {54 vars in 964 bytes} [Mon Jul 25 21:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:51:36.484312 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e07b-f29c-49e6-9048-7374547debf2 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.484600 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e07b-f29c-49e6-9048-7374547debf2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.484877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e07b-f29c-49e6-9048-7374547debf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.503823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-36d4e07b-f29c-49e6-9048-7374547debf2 None None] MFA Rules not processed for user `f785ecee24d24cd4941c744c4ad17a23`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:36.504943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-36d4e07b-f29c-49e6-9048-7374547debf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:36.547539 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:36.555696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 559/1121] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Jul 25 21:51:36 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:51:36.565302 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f75f5-8d34-4e4d-a7ab-dc08fc983d51 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.575518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f75f5-8d34-4e4d-a7ab-dc08fc983d51 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.579410 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f785ecee24d24cd4941c744c4ad17a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.580006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.580279 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.580545 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.588466 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.589874 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.599236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 563/1122] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:51:36 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:51:36.636954 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcf3fc-62a5-4e45-9529-bbbb77f88ae1 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.637236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcf3fc-62a5-4e45-9529-bbbb77f88ae1 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.637507 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcf3fc-62a5-4e45-9529-bbbb77f88ae1 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.639288 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 560/1123] 10.222.0.18 () {52 vars in 830 bytes} [Mon Jul 25 21:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:51:36.642837 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.703448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fa97b-0a7c-4dfd-9953-0cb2494a451f service cinder] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.707869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.708527 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.708805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.709078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] PATH_INFO: `/v3/users/f4f335d4516644a7b53e8c6ca55f1b42` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.710233 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f335d4516644a7b53e8c6ca55f1b42)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.711267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:36.711267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 21:51:36.711267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 21:51:36.712462 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:36.777601 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f335d4516644a7b53e8c6ca55f1b42'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:36.778281 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f335d4516644a7b53e8c6ca55f1b42'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:36.791682 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f335d4516644a7b53e8c6ca55f1b42'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:36.792370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f335d4516644a7b53e8c6ca55f1b42'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:36.811637 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f335d4516644a7b53e8c6ca55f1b42'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:36.826363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 564/1124] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 21:51:36 2022] DELETE /identity/v3/users/f4f335d4516644a7b53e8c6ca55f1b42 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:51:36.830704 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.831018 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.831290 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.849920 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:36.851170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:36.907414 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 561/1125] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:51:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:51:36.917831 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:36.919223 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:36.925609 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:36.977211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03186b-8e2e-4830-a5cf-0e2198020132 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:36.980758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1c7d-2195-4e5c-bb96-bf69f6f699b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:36.981367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1c7d-2195-4e5c-bb96-bf69f6f699b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:36.981642 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1c7d-2195-4e5c-bb96-bf69f6f699b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:36.981912 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1c7d-2195-4e5c-bb96-bf69f6f699b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:36.991235 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f1c7d-2195-4e5c-bb96-bf69f6f699b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:36.992647 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f1c7d-2195-4e5c-bb96-bf69f6f699b9 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:37.001738 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 565/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:51:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:51:37.323332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:37.325313 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:37.339089 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffed7e-6f3f-4a55-a8f4-0c4092468e70 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:37.343805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:37.344412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:37.344693 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:37.344972 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] PATH_INFO: `/v3/projects/55fce512468c42898a301232689aa12d` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:37.346136 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fce512468c42898a301232689aa12d)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:37.347182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:37.347182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:51:37.347182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:51:37.348460 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:37.407896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fce512468c42898a301232689aa12d', 'request_id': 'req-00ddbb27-85c2-43e4-9100-1c9da652ace7'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:37.422103 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fce512468c42898a301232689aa12d', 'request_id': 'req-00ddbb27-85c2-43e4-9100-1c9da652ace7'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:37.428354 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fce512468c42898a301232689aa12d', 'request_id': 'req-00ddbb27-85c2-43e4-9100-1c9da652ace7'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:37.442188 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] The token cache is being invalidate because project 55fce512468c42898a301232689aa12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:51:37.442471 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:37.443096 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-00ddbb27-85c2-43e4-9100-1c9da652ace7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:37.444664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 562/1127] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 21:51:37 2022] DELETE /identity/v3/projects/55fce512468c42898a301232689aa12d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:51:46.997858 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=25 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:47.439237 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:04.141840 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6d2e-868a-41d0-a67e-3b69643852e4 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:04.142435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6d2e-868a-41d0-a67e-3b69643852e4 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:04.142435 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6d2e-868a-41d0-a67e-3b69643852e4 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:04.143771 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:04.148576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ea05-0aec-4e72-9f50-6147bd13045c None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:04.148983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ea05-0aec-4e72-9f50-6147bd13045c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:04.149121 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97ea05-0aec-4e72-9f50-6147bd13045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:04.220713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-cb97ea05-0aec-4e72-9f50-6147bd13045c None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:04.221902 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-cb97ea05-0aec-4e72-9f50-6147bd13045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:04.439857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:53:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:04.604886 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6d2e-868a-41d0-a67e-3b69643852e4 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:04.607160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-8e7c6d2e-868a-41d0-a67e-3b69643852e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:04.692703 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6d2e-868a-41d0-a67e-3b69643852e4 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:04.697598 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0c24-3a98-46b3-a396-812936595a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:04.698206 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0c24-3a98-46b3-a396-812936595a78 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:04.698488 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0c24-3a98-46b3-a396-812936595a78 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:04.698761 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0c24-3a98-46b3-a396-812936595a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:04.706746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0c24-3a98-46b3-a396-812936595a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:04.708370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0c24-3a98-46b3-a396-812936595a78 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:04.718017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 567/1130] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:05.555170 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21b38-b755-4a06-b28c-5fa25efec721 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:05.555739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21b38-b755-4a06-b28c-5fa25efec721 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:05.555739 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21b38-b755-4a06-b28c-5fa25efec721 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:05.557071 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:05.562345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f333c-43ac-4e6a-a96b-fff0952f52ef None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:05.562773 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f333c-43ac-4e6a-a96b-fff0952f52ef None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:05.562884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f333c-43ac-4e6a-a96b-fff0952f52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:05.582766 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-dc6f333c-43ac-4e6a-a96b-fff0952f52ef None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:05.584000 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-dc6f333c-43ac-4e6a-a96b-fff0952f52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:05.592243 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:53:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:53:05.748707 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21b38-b755-4a06-b28c-5fa25efec721 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:05.761853 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21b38-b755-4a06-b28c-5fa25efec721 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:05.767371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bde0b-4e56-4455-86d2-757e36c3035f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:05.767970 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bde0b-4e56-4455-86d2-757e36c3035f service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:05.768250 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bde0b-4e56-4455-86d2-757e36c3035f service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:05.768520 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bde0b-4e56-4455-86d2-757e36c3035f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:05.776639 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bde0b-4e56-4455-86d2-757e36c3035f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:05.778284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bde0b-4e56-4455-86d2-757e36c3035f service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:05.787632 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 565/1133] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:10.101328 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1fe9-0e74-477b-ad27-4b35fc2a0e8b None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:10.101861 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1fe9-0e74-477b-ad27-4b35fc2a0e8b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:10.101980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1fe9-0e74-477b-ad27-4b35fc2a0e8b None None] PATH_INFO: `/v3` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:10.103236 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 569/1134] 10.222.0.45 () {54 vars in 925 bytes} [Mon Jul 25 21:53:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:53:10.109313 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bfcf2-e9ad-45d8-922a-202ae9d7e3a4 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:10.109752 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bfcf2-e9ad-45d8-922a-202ae9d7e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:10.109861 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bfcf2-e9ad-45d8-922a-202ae9d7e3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:10.138358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-780bfcf2-e9ad-45d8-922a-202ae9d7e3a4 None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:10.139509 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-780bfcf2-e9ad-45d8-922a-202ae9d7e3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:10.196175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:10.208646 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 566/1135] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Jul 25 21:53:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:14.301114 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1afc-c338-4142-9405-f22c7fccb5e8 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:14.301629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1afc-c338-4142-9405-f22c7fccb5e8 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:14.301629 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1afc-c338-4142-9405-f22c7fccb5e8 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:14.303002 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 570/1136] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jul 25 21:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:14.307935 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e30a8-8748-4205-84c2-5444c06288c2 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:14.308385 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e30a8-8748-4205-84c2-5444c06288c2 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:14.308483 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e30a8-8748-4205-84c2-5444c06288c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:14.328017 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-604e30a8-8748-4205-84c2-5444c06288c2 None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:14.329180 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-604e30a8-8748-4205-84c2-5444c06288c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:14.337424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 567/1137] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jul 25 21:53:14 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:14.344662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1afc-c338-4142-9405-f22c7fccb5e8 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:14.358157 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1afc-c338-4142-9405-f22c7fccb5e8 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:14.363111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22444a-e2ae-4fad-910a-282daf31cffe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:14.363741 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22444a-e2ae-4fad-910a-282daf31cffe service placement] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:14.364021 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22444a-e2ae-4fad-910a-282daf31cffe service placement] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:14.364298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22444a-e2ae-4fad-910a-282daf31cffe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:14.373206 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22444a-e2ae-4fad-910a-282daf31cffe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:14.374780 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22444a-e2ae-4fad-910a-282daf31cffe service placement] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:14.384153 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 571/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:14 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:17.035092 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba902-74fe-4662-a483-0cfcd56e15b9 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:17.035644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba902-74fe-4662-a483-0cfcd56e15b9 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:17.035644 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba902-74fe-4662-a483-0cfcd56e15b9 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:17.036953 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:17.041920 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c7e7-a0ae-46a0-a25e-18feb7f2ff12 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:17.042320 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c7e7-a0ae-46a0-a25e-18feb7f2ff12 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:17.042479 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3c7e7-a0ae-46a0-a25e-18feb7f2ff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:17.062461 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-6ca3c7e7-a0ae-46a0-a25e-18feb7f2ff12 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:17.063675 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-6ca3c7e7-a0ae-46a0-a25e-18feb7f2ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:17.071323 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:53:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:17.232283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ba902-74fe-4662-a483-0cfcd56e15b9 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:17.245420 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ba902-74fe-4662-a483-0cfcd56e15b9 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:17.250869 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43a47d-6d44-4415-8ccb-220a5155ed32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:17.251490 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43a47d-6d44-4415-8ccb-220a5155ed32 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:17.251763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43a47d-6d44-4415-8ccb-220a5155ed32 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:17.252031 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43a47d-6d44-4415-8ccb-220a5155ed32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:17.259826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43a47d-6d44-4415-8ccb-220a5155ed32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:17.261387 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43a47d-6d44-4415-8ccb-220a5155ed32 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:17.271377 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 569/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:18.104895 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8488ae-01ef-46a1-a1b0-0bcaeab1b883 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:18.105554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8488ae-01ef-46a1-a1b0-0bcaeab1b883 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:18.105554 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8488ae-01ef-46a1-a1b0-0bcaeab1b883 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:18.106785 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 573/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:18.111561 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697fe6-9559-4391-87ba-440380b23f41 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:18.111976 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697fe6-9559-4391-87ba-440380b23f41 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:18.112097 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697fe6-9559-4391-87ba-440380b23f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:18.131955 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-ed697fe6-9559-4391-87ba-440380b23f41 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:18.133144 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-ed697fe6-9559-4391-87ba-440380b23f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:18.141519 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 570/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:53:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:18.299451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8488ae-01ef-46a1-a1b0-0bcaeab1b883 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:18.313199 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8488ae-01ef-46a1-a1b0-0bcaeab1b883 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:18.318108 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d39ac-5543-4759-8713-ca5835512373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:18.318708 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d39ac-5543-4759-8713-ca5835512373 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:18.319017 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d39ac-5543-4759-8713-ca5835512373 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:18.319293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d39ac-5543-4759-8713-ca5835512373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:18.327293 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d39ac-5543-4759-8713-ca5835512373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:18.328860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d39ac-5543-4759-8713-ca5835512373 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:18.338014 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 574/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:22.580082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ebe6-be81-43c5-961d-d3d98ea7ef2a None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:22.580724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ebe6-be81-43c5-961d-d3d98ea7ef2a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:22.580724 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ebe6-be81-43c5-961d-d3d98ea7ef2a None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:22.581946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:53:22.587032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d395a-382c-486b-af8c-f77d6c346cf5 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:22.587477 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d395a-382c-486b-af8c-f77d6c346cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:22.587579 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d395a-382c-486b-af8c-f77d6c346cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:22.606951 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-1b5d395a-382c-486b-af8c-f77d6c346cf5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:22.608154 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-1b5d395a-382c-486b-af8c-f77d6c346cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:22.615816 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:53:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:53:22.653989 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ebe6-be81-43c5-961d-d3d98ea7ef2a None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:22.655672 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-4cd7ebe6-be81-43c5-961d-d3d98ea7ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:22.710339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ebe6-be81-43c5-961d-d3d98ea7ef2a None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:22.713709 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a20b0-333c-4be2-9b0d-e85f247ffc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:22.714302 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a20b0-333c-4be2-9b0d-e85f247ffc92 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:22.714575 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a20b0-333c-4be2-9b0d-e85f247ffc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:22.715374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a20b0-333c-4be2-9b0d-e85f247ffc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:22.723960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a20b0-333c-4be2-9b0d-e85f247ffc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:22.725421 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a20b0-333c-4be2-9b0d-e85f247ffc92 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:22.734999 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 572/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:24.920546 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c6d4-4f49-48a0-ac2a-16294d2bb96f None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:24.921077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c6d4-4f49-48a0-ac2a-16294d2bb96f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:24.921077 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c6d4-4f49-48a0-ac2a-16294d2bb96f None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:24.922364 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:24.927512 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127823e-71e2-4a1b-b205-7b765fedf10e None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:24.927924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127823e-71e2-4a1b-b205-7b765fedf10e None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:24.928062 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127823e-71e2-4a1b-b205-7b765fedf10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:24.947513 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-4127823e-71e2-4a1b-b205-7b765fedf10e None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:24.948682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-4127823e-71e2-4a1b-b205-7b765fedf10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:24.956829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:53:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:24.994690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c6d4-4f49-48a0-ac2a-16294d2bb96f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:25.006084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c6d4-4f49-48a0-ac2a-16294d2bb96f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:25.009582 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab38f87-a7e5-42e0-aff9-30389d39727b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:25.010189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab38f87-a7e5-42e0-aff9-30389d39727b service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:25.010469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab38f87-a7e5-42e0-aff9-30389d39727b service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:25.010745 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab38f87-a7e5-42e0-aff9-30389d39727b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:25.019486 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab38f87-a7e5-42e0-aff9-30389d39727b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:25.020910 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab38f87-a7e5-42e0-aff9-30389d39727b service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:25.030618 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 577/1150] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:28.966830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c105e7-2f9a-4d38-8241-4f05ef04f719 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:28.967446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c105e7-2f9a-4d38-8241-4f05ef04f719 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:28.967446 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c105e7-2f9a-4d38-8241-4f05ef04f719 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:28.968753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:28.973869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da64750-38a9-403c-8df8-b8618ba93cd5 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:28.974304 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da64750-38a9-403c-8df8-b8618ba93cd5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:28.974414 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da64750-38a9-403c-8df8-b8618ba93cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:28.982109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=67 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:28.994389 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-6da64750-38a9-403c-8df8-b8618ba93cd5 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:28.995632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-6da64750-38a9-403c-8df8-b8618ba93cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:29.003770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:53:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:29.275283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c105e7-2f9a-4d38-8241-4f05ef04f719 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:29.276933 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-66c105e7-2f9a-4d38-8241-4f05ef04f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:29.334012 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c105e7-2f9a-4d38-8241-4f05ef04f719 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:29.337497 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22103067-1462-430a-a54d-c23086ddfafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f785ecee24d24cd4941c744c4ad17a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:29.338101 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103067-1462-430a-a54d-c23086ddfafb service cinder] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:29.338380 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103067-1462-430a-a54d-c23086ddfafb service cinder] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:29.338652 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103067-1462-430a-a54d-c23086ddfafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:29.348175 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22103067-1462-430a-a54d-c23086ddfafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:29.349597 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22103067-1462-430a-a54d-c23086ddfafb service cinder] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:29.358983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 575/1153] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:31.600515 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103404-8ac1-4065-bd08-1bd9cc13c864 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:31.601076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103404-8ac1-4065-bd08-1bd9cc13c864 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:31.601076 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103404-8ac1-4065-bd08-1bd9cc13c864 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:31.602393 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:53:31.607559 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330595-7d7d-4f5d-bed8-541ace4ca1a0 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:31.607992 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330595-7d7d-4f5d-bed8-541ace4ca1a0 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:31.608194 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76330595-7d7d-4f5d-bed8-541ace4ca1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:31.627296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-76330595-7d7d-4f5d-bed8-541ace4ca1a0 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:31.628462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-76330595-7d7d-4f5d-bed8-541ace4ca1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:31.636064 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:53:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:31.903576 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103404-8ac1-4065-bd08-1bd9cc13c864 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:31.905230 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c4103404-8ac1-4065-bd08-1bd9cc13c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:31.919212 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103404-8ac1-4065-bd08-1bd9cc13c864 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:31.922573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93734676-f323-4676-a6ac-09d42d4d63c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f785ecee24d24cd4941c744c4ad17a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:31.923205 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734676-f323-4676-a6ac-09d42d4d63c7 service cinder] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:31.923479 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734676-f323-4676-a6ac-09d42d4d63c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:31.923746 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734676-f323-4676-a6ac-09d42d4d63c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:31.932498 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93734676-f323-4676-a6ac-09d42d4d63c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:31.933954 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93734676-f323-4676-a6ac-09d42d4d63c7 service cinder] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:31.943193 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 580/1156] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:41.622624 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=70 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:41.939219 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=8 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:54:51.800352 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89a0c2-1617-4cbe-9cdb-d5b05fc195fa None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.800948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89a0c2-1617-4cbe-9cdb-d5b05fc195fa None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.800948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89a0c2-1617-4cbe-9cdb-d5b05fc195fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.806291 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604417-e50f-4f3c-aa93-ed1046f622ea None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.806833 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604417-e50f-4f3c-aa93-ed1046f622ea None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.806960 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604417-e50f-4f3c-aa93-ed1046f622ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.819615 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-9b89a0c2-1617-4cbe-9cdb-d5b05fc195fa None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:51.826237 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-03604417-e50f-4f3c-aa93-ed1046f622ea None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:51.826431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-9b89a0c2-1617-4cbe-9cdb-d5b05fc195fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:51.827476 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-03604417-e50f-4f3c-aa93-ed1046f622ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:51.834057 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 577/1157] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:54:51.835261 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 581/1158] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:54:51.842614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.842893 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.843193 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.843390 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.843678 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.843955 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.862227 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:51.862456 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:51.863459 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:51.863635 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:51.872158 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 578/1159] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:54:51.875891 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 582/1160] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:54:51.876946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:51.877372 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:51.886861 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0225de-18c0-46cf-8373-bab2f87e9f3f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:51.887363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89456a2-f5b6-47d8-b7af-cb943f5eea19 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:51.891439 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:51.892032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:51.892162 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.892401 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.892675 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.892783 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.892986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.893261 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] PATH_INFO: `/v3/domains` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.893943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87160) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:54:51.894063 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87159) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:54:51.894237 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:51.894345 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:51.895329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:54:51.895329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 21:54:51.895329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 21:54:51.895948 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:51.896354 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:51.907768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 579/1161] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 21:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:54:51.908328 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 583/1162] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Jul 25 21:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:54:51.915835 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:51.916567 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:51.925528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161b19-d364-487a-9e93-7342d561de97 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:51.926029 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ecc82-26e9-4eff-8b92-642988f3dad7 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:51.930051 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:51.930490 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:51.930648 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.930946 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.931132 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:51.931245 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.931413 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:51.932211 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:51.932382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:51.932857 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:51.933379 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:54:51.933379 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:54:51.933379 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:54:51.934543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:51.934758 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:51.974888 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 584/1163] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:54:51.977403 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 580/1164] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:54:51.979708 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:51.983912 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.044053 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa8c2b-37a5-424d-911a-528149e03fa7 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.046442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6085805-dcd7-4383-ba02-977212113538 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.048702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.049315 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.049592 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.049873 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.050582 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.051236 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.051571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:54:52.051571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 21:54:52.051571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 21:54:52.051944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.052093 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.052361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.052760 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.053005 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.054942 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.076917 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 585/1165] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:54:52.077522 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 581/1166] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:54:51 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:54:52.081107 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.081282 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.091220 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831f11e-e054-46f4-a7b3-abb9dde056e1 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.091386 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebd395-c72a-4d92-a4e0-0966c171cce3 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.095697 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.095907 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.096375 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.096491 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.096639 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.096745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.096936 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.097053 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.097610 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.097716 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.099322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.099715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.109762 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 586/1167] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:54:52.112735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 582/1168] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:54:52.113695 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.113815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.123009 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966ef3-642d-4c1a-93b8-40a87f7931f5 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.123168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250fec9-63e1-4369-bf1e-fc731dfe8812 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.127441 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.127645 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.128024 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.128226 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.128353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.128502 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.128623 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.128771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.129203 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.129436 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.130860 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.131167 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.142595 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 587/1169] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:54:52.144502 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 583/1170] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:54:52.146845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.148565 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.157523 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1511-8b3b-40c2-bbab-1721d2a98847 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.158955 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b363-41ff-4168-909c-1f179d245fdb admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.162303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c656c7-0044-4350-b0bd-9c075ade171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.163184 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c656c7-0044-4350-b0bd-9c075ade171a admin admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.163500 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.163630 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c656c7-0044-4350-b0bd-9c075ade171a admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.163769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c656c7-0044-4350-b0bd-9c075ade171a admin admin] PATH_INFO: `/v3/projects/b5c794ffb0b645f8be70f71ba4ce2a2d/users/3008e360cec04afa8143b89cc97c1b37/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.164135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.164410 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.164677 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] PATH_INFO: `/v3/projects/6dc3059736e048c49f38255aa1d1f39b/users/542a9d36a7b44e658747981f82df43e4/roles/abb02adff3a84d22a1b1b382e4c95e68` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.178450 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c656c7-0044-4350-b0bd-9c075ade171a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c794ffb0b645f8be70f71ba4ce2a2d, user_id=3008e360cec04afa8143b89cc97c1b37, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.180173 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc3059736e048c49f38255aa1d1f39b, user_id=542a9d36a7b44e658747981f82df43e4, role_id=abb02adff3a84d22a1b1b382e4c95e68)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.181944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:54:52.181944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 21:54:52.181944 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 21:54:52.182408 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c656c7-0044-4350-b0bd-9c075ade171a admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.183854 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6533fb-e99d-4393-a011-b66d5c6f716d admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.195939 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 588/1171] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:54:52 2022] PUT /identity/v3/projects/b5c794ffb0b645f8be70f71ba4ce2a2d/users/3008e360cec04afa8143b89cc97c1b37/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:54:52.197960 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 584/1172] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:54:52 2022] PUT /identity/v3/projects/6dc3059736e048c49f38255aa1d1f39b/users/542a9d36a7b44e658747981f82df43e4/roles/abb02adff3a84d22a1b1b382e4c95e68 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:54:52.201493 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.201986 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.202267 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.203200 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.203488 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.203763 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.220877 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:52.221921 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] MFA Rules not processed for user `a5621789b9f4468f90a50f03b6178b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:52.222100 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:52.223112 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:52.269389 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:54:52.270390 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:54:52.288468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 585/1173] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:54:52.289052 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 589/1174] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:54:52.301442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.302826 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:52.304359 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:52.305693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:52.369090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f38fe-bd4f-4954-99fa-be12cae40732 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.371581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90c88e-0208-422a-9371-c5e3a53ca33f None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:52.372795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7de62-bd5a-475f-8cd0-e6420436095c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.373413 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7de62-bd5a-475f-8cd0-e6420436095c service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.373698 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7de62-bd5a-475f-8cd0-e6420436095c service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.373963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7de62-bd5a-475f-8cd0-e6420436095c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.375469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:52.376046 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:52.376327 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:52.376598 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:52.383271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7de62-bd5a-475f-8cd0-e6420436095c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.385332 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7de62-bd5a-475f-8cd0-e6420436095c service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.386170 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:52.387650 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:52.394896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 586/1175] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:54:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:54:52.396847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 590/1176] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:54:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:54:57.741307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:57.741911 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:57.741911 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:57.786631 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] MFA Rules not processed for user `3008e360cec04afa8143b89cc97c1b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:57.787919 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:57.870263 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 587/1177] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:57 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:54:57.874889 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:57.885453 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b67d-1c25-4719-9e6b-1d339a46d426 service neutron] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:57.891471 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:57.892122 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:57.892403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:57.892678 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] PATH_INFO: `/v3/projects` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:57.893367 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:57.895489 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:57.928616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 591/1178] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 21:54:57 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:54:57.933514 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:57.946113 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48082be8-28a5-4ef3-98a1-e68a159b6633 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:58.046220 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:58.046867 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:58.054461 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:58.055247 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] PATH_INFO: `/v3/users` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:58.055532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:58.061137 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:58.083528 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:54:58.096080 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 588/1179] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:54:57 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:54:58.098108 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:58.109284 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ba8df-7fe0-480a-a5c1-1556f1cdde27 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:58.119976 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:58.120492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:58.121098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:58.121098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:58.121966 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:58.123896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:58.142851 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 592/1180] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:54:58.147168 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:58.159711 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69dc9-8048-4bd9-9394-be5ab0e57952 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:58.165382 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:58.166385 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:58.166696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:58.167078 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] PATH_INFO: `/v3/projects/1655a4554dd049bebf9643bf80d1c19f/users/0126a7ba07854f7fbbba0c1c444983af/roles/068868605675478a8abe0ef53a447f78` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:58.189648 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1655a4554dd049bebf9643bf80d1c19f, user_id=0126a7ba07854f7fbbba0c1c444983af, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:58.195843 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:58.230174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 589/1181] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:54:58 2022] PUT /identity/v3/projects/1655a4554dd049bebf9643bf80d1c19f/users/0126a7ba07854f7fbbba0c1c444983af/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:54:58.234666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:58.250426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba155d57-7a7b-4ffe-9e31-2cabd78f3284 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:58.348748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd2d09-79f2-4c76-9eef-142f096e847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:58.349557 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd2d09-79f2-4c76-9eef-142f096e847c admin admin] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:58.349937 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd2d09-79f2-4c76-9eef-142f096e847c admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:58.350307 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd2d09-79f2-4c76-9eef-142f096e847c admin admin] PATH_INFO: `/v3/roles` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:58.351197 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd2d09-79f2-4c76-9eef-142f096e847c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:58.354333 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd2d09-79f2-4c76-9eef-142f096e847c admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:58.376259 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 593/1182] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:54:58.380386 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:58.394855 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72d2aa-a307-452f-8bdc-cbd8e9d95311 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:58.411761 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:58.412793 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] REQUEST_METHOD: `PUT` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:58.414468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:58.414869 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] PATH_INFO: `/v3/projects/1655a4554dd049bebf9643bf80d1c19f/users/0126a7ba07854f7fbbba0c1c444983af/roles/068868605675478a8abe0ef53a447f78` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:58.417962 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1655a4554dd049bebf9643bf80d1c19f, user_id=0126a7ba07854f7fbbba0c1c444983af, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:58.420813 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:58.432789 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 590/1183] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:54:58 2022] PUT /identity/v3/projects/1655a4554dd049bebf9643bf80d1c19f/users/0126a7ba07854f7fbbba0c1c444983af/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:54:59.372330 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:59.372920 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:59.372920 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:59.441989 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:54:59.444172 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:54:59.554167 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:54:59.656406 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 594/1184] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:54:59 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:54:59.659284 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:59.807881 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa217bc-53c8-4692-a99e-67ad955c5215 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:54:59.820174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:54:59.820829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:54:59.821108 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:54:59.821381 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:54:59.822584 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:54:59.824801 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:54:59.898591 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 591/1185] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Jul 25 21:54:59 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:54:59.899958 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:54:59.920722 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e721c6b-49c1-4ffb-a041-902b52ce24c8 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:00.083428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:00.084795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:00.085078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:00.085355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:00.086049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:00.093805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:00.136247 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 595/1186] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Jul 25 21:54:59 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:55:00.138183 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:00.153470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f8134-e007-4224-ac79-673ec24c46a9 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:00.167023 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:00.167678 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:00.167954 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:00.168225 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:00.168961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:00.170562 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:00.186454 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 592/1187] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:55:00.190953 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:00.203269 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ccd27-eeca-40b1-b6cd-54ad639cbbf0 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:00.208681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:00.209509 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:00.210312 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:00.210633 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] PATH_INFO: `/v3/projects/78c15661162c4e2fa4848b44bd814a81/users/bb5b803504df482b881755ef7f48704a/roles/068868605675478a8abe0ef53a447f78` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:00.232660 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c15661162c4e2fa4848b44bd814a81, user_id=bb5b803504df482b881755ef7f48704a, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:00.240741 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:00.273403 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 596/1188] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:55:00 2022] PUT /identity/v3/projects/78c15661162c4e2fa4848b44bd814a81/users/bb5b803504df482b881755ef7f48704a/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:55:00.277696 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:00.290938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e31e-46e1-40cc-8c19-c21a5411889f admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:00.430399 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1c087-9245-4fd2-bcbe-364229e24352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:00.431207 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1c087-9245-4fd2-bcbe-364229e24352 admin admin] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:00.432417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1c087-9245-4fd2-bcbe-364229e24352 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:00.432792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1c087-9245-4fd2-bcbe-364229e24352 admin admin] PATH_INFO: `/v3/roles` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:00.433526 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1c087-9245-4fd2-bcbe-364229e24352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:00.437377 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1c087-9245-4fd2-bcbe-364229e24352 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:00.470996 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 593/1189] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Jul 25 21:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:55:00.473550 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:00.489436 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015c3dc-3c9b-4bb6-8d6c-5990e65a6be9 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:00.505111 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:00.506218 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] REQUEST_METHOD: `PUT` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:00.506662 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:00.506952 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] PATH_INFO: `/v3/projects/78c15661162c4e2fa4848b44bd814a81/users/bb5b803504df482b881755ef7f48704a/roles/068868605675478a8abe0ef53a447f78` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:00.514163 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c15661162c4e2fa4848b44bd814a81, user_id=bb5b803504df482b881755ef7f48704a, role_id=068868605675478a8abe0ef53a447f78)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:00.516896 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:00.541980 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 597/1190] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Jul 25 21:55:00 2022] PUT /identity/v3/projects/78c15661162c4e2fa4848b44bd814a81/users/bb5b803504df482b881755ef7f48704a/roles/068868605675478a8abe0ef53a447f78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:55:04.780934 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53255bca-c02f-47c6-8ac0-ecb98675e405 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:04.781516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53255bca-c02f-47c6-8ac0-ecb98675e405 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:04.781516 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53255bca-c02f-47c6-8ac0-ecb98675e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:04.819524 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-53255bca-c02f-47c6-8ac0-ecb98675e405 None None] MFA Rules not processed for user `0126a7ba07854f7fbbba0c1c444983af`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:04.821021 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-53255bca-c02f-47c6-8ac0-ecb98675e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:04.869510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:04.975768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 594/1191] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:55:04 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:04.988010 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:04.993492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:05.099335 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f645-7d39-4bc6-91ea-9193eaa4e40b admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:05.109962 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b30a7d7bf84bf993efa9444b9a419f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:05.110784 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:05.111184 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:05.111552 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:05.317421 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:05.369774 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:05.371694 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:05.386952 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 598/1192] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:04 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:55:06.645128 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8a31-883b-4523-9996-05f9595e9f5a None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:06.646431 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8a31-883b-4523-9996-05f9595e9f5a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:06.647077 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d8a31-883b-4523-9996-05f9595e9f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:06.684434 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-480d8a31-883b-4523-9996-05f9595e9f5a None None] MFA Rules not processed for user `bb5b803504df482b881755ef7f48704a`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:06.686018 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-480d8a31-883b-4523-9996-05f9595e9f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:06.802412 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 595/1193] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:55:06 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:06.813583 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:06.823298 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b86df-a3e4-45b1-95f5-feb6d7f4a84d service glance] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:06.827185 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38d7a0-e207-4138-8702-de461bc5cb30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b30a7d7bf84bf993efa9444b9a419f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:06.827827 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38d7a0-e207-4138-8702-de461bc5cb30 service glance] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:06.828104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38d7a0-e207-4138-8702-de461bc5cb30 service glance] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:06.828380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38d7a0-e207-4138-8702-de461bc5cb30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:06.925951 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38d7a0-e207-4138-8702-de461bc5cb30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:06.928078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38d7a0-e207-4138-8702-de461bc5cb30 service glance] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:06.943485 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 599/1194] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:06 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:55:14.494404 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae239a-1280-4a0f-aabb-e937ce9d7052 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:14.495038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae239a-1280-4a0f-aabb-e937ce9d7052 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:14.495038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae239a-1280-4a0f-aabb-e937ce9d7052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:14.521160 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-c6ae239a-1280-4a0f-aabb-e937ce9d7052 None None] MFA Rules not processed for user `3008e360cec04afa8143b89cc97c1b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:14.522371 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c6ae239a-1280-4a0f-aabb-e937ce9d7052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:14.535224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 596/1195] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:55:14 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:14.828718 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12729-7ecc-49a5-8e31-97528bb317a7 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:14.829239 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12729-7ecc-49a5-8e31-97528bb317a7 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:14.829470 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca12729-7ecc-49a5-8e31-97528bb317a7 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:14.830959 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 600/1196] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 21:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:55:14.839469 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d2ddc-6392-4f63-b907-1e8c4ee003c7 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:14.839758 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d2ddc-6392-4f63-b907-1e8c4ee003c7 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:14.840039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d2ddc-6392-4f63-b907-1e8c4ee003c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:14.880804 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-649d2ddc-6392-4f63-b907-1e8c4ee003c7 None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:14.882141 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-649d2ddc-6392-4f63-b907-1e8c4ee003c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:14.952596 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 597/1197] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 21:55:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:14.958666 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40a64-d86f-4025-a918-bf6a57ada11b None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:14.958993 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40a64-d86f-4025-a918-bf6a57ada11b None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:14.959271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40a64-d86f-4025-a918-bf6a57ada11b None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:14.960763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 601/1198] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 21:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:55:14.965611 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee054fe-2d63-416d-aff2-b5c9ad586e4a None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:14.965896 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee054fe-2d63-416d-aff2-b5c9ad586e4a None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:14.966172 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee054fe-2d63-416d-aff2-b5c9ad586e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:14.985735 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-eee054fe-2d63-416d-aff2-b5c9ad586e4a None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:14.986943 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-eee054fe-2d63-416d-aff2-b5c9ad586e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:14.996122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 598/1199] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 21:55:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:15.007842 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a40a64-d86f-4025-a918-bf6a57ada11b None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:15.009539 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-25a40a64-d86f-4025-a918-bf6a57ada11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:15.024388 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a40a64-d86f-4025-a918-bf6a57ada11b None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:15.029049 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e718743-d892-4f58-8439-8de4aec8fd28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b30a7d7bf84bf993efa9444b9a419f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:15.029677 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e718743-d892-4f58-8439-8de4aec8fd28 service glance] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:15.029944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e718743-d892-4f58-8439-8de4aec8fd28 service glance] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:15.030218 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e718743-d892-4f58-8439-8de4aec8fd28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:15.041360 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e718743-d892-4f58-8439-8de4aec8fd28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:15.042821 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e718743-d892-4f58-8439-8de4aec8fd28 service glance] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:15.056815 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 602/1200] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:55:15.388182 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f00d-d112-49b3-81ff-372bbd8f1d3f None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:15.388470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f00d-d112-49b3-81ff-372bbd8f1d3f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:15.388753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33f00d-d112-49b3-81ff-372bbd8f1d3f None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:15.390256 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 599/1201] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 21:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:55:15.395042 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f255-5809-4faf-94bb-512413907f8f None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:15.395328 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f255-5809-4faf-94bb-512413907f8f None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:15.395628 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9f255-5809-4faf-94bb-512413907f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:15.417494 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-3ae9f255-5809-4faf-94bb-512413907f8f None None] MFA Rules not processed for user `7ae653f590784ee894b3d00dd83790f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:15.419057 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-3ae9f255-5809-4faf-94bb-512413907f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:15.470993 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 603/1202] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 21:55:15 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:15.482845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f00d-d112-49b3-81ff-372bbd8f1d3f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:15.494238 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33f00d-d112-49b3-81ff-372bbd8f1d3f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:15.498165 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd98680-3c9b-437f-b147-781b3d2a6b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:15.498784 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd98680-3c9b-437f-b147-781b3d2a6b92 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:15.499061 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd98680-3c9b-437f-b147-781b3d2a6b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:15.499334 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd98680-3c9b-437f-b147-781b3d2a6b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:15.506372 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd98680-3c9b-437f-b147-781b3d2a6b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:15.507891 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd98680-3c9b-437f-b147-781b3d2a6b92 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:15.512082 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=100 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:15.516777 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 600/1203] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:15 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:55:16.037006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b557-b6a8-4e3e-8129-0043e834d760 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.037596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b557-b6a8-4e3e-8129-0043e834d760 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.037596 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b557-b6a8-4e3e-8129-0043e834d760 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.038873 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 604/1204] 10.222.0.18 () {54 vars in 962 bytes} [Mon Jul 25 21:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:55:16.050557 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085310-ab1e-469a-aa52-424b4151ea6d None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.050990 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085310-ab1e-469a-aa52-424b4151ea6d None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.051330 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84085310-ab1e-469a-aa52-424b4151ea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.067526 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd292c-7758-4292-b38f-c7424d173cf8 None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.067737 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd292c-7758-4292-b38f-c7424d173cf8 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.068016 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd292c-7758-4292-b38f-c7424d173cf8 None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.069506 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 605/1205] 10.222.0.18 () {54 vars in 961 bytes} [Mon Jul 25 21:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:55:16.075109 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.075395 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.075668 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.093079 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-84085310-ab1e-469a-aa52-424b4151ea6d None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:16.095364 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-84085310-ab1e-469a-aa52-424b4151ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:16.097055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:16.098228 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:16.105881 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 601/1206] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Jul 25 21:55:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:16.112274 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3b5b-0dfa-4cea-9e7a-abf4e0a50e59 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.113725 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3b5b-0dfa-4cea-9e7a-abf4e0a50e59 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.114109 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3b5b-0dfa-4cea-9e7a-abf4e0a50e59 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.119661 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 602/1207] 10.222.0.18 () {54 vars in 912 bytes} [Mon Jul 25 21:55:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:55:16.130657 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.131964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.133342 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.164869 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:16.165693 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=100 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:16.166383 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:16.176768 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 603/1208] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 21:55:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:16.184350 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 606/1209] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Jul 25 21:55:16 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:55:16.189343 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:16.192370 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:16.202217 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fd888-31c8-453c-a0f2-39c6f3e832bc None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:16.203510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffcc4a-7142-43a8-8a48-cea513b78b51 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:16.206150 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1489f76-892c-496a-aae6-85eb7302ae14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:16.206850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1489f76-892c-496a-aae6-85eb7302ae14 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.207245 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1489f76-892c-496a-aae6-85eb7302ae14 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.207599 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1489f76-892c-496a-aae6-85eb7302ae14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.210054 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:16.210672 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:16.210979 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:16.211255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:16.213581 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:16.219401 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1489f76-892c-496a-aae6-85eb7302ae14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:16.220927 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1489f76-892c-496a-aae6-85eb7302ae14 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:16.226393 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:16.228065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:16.232321 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 604/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:16 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:55:16.238543 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 607/1211] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:16 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:55:26.227814 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=12 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:26.233975 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=7 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:26.453757 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1617-9a95-42cc-a8b4-323e7e00ee1c None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:26.454020 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1617-9a95-42cc-a8b4-323e7e00ee1c None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:26.454324 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1617-9a95-42cc-a8b4-323e7e00ee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:26.478729 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-8c1d1617-9a95-42cc-a8b4-323e7e00ee1c None None] MFA Rules not processed for user `7ae653f590784ee894b3d00dd83790f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:26.479964 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-8c1d1617-9a95-42cc-a8b4-323e7e00ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:26.486363 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 605/1212] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Jul 25 21:55:26 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:26.498769 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:26.510642 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c450d-96d7-4acc-88bc-3cd337a5cc02 service placement] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:26.516949 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7a616-bb1f-4b70-8163-0fdb56b578d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:26.517681 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7a616-bb1f-4b70-8163-0fdb56b578d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:26.518025 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7a616-bb1f-4b70-8163-0fdb56b578d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:26.518311 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7a616-bb1f-4b70-8163-0fdb56b578d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:26.526534 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7a616-bb1f-4b70-8163-0fdb56b578d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:26.528006 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7a616-bb1f-4b70-8163-0fdb56b578d1 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:26.536033 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 608/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:26 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:55:27.492721 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835cd73-f1e9-470b-aa51-b09c44acf69f None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:27.493752 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835cd73-f1e9-470b-aa51-b09c44acf69f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:27.494374 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835cd73-f1e9-470b-aa51-b09c44acf69f None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:27.496916 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 606/1214] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 21:55:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:55:27.514004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f06c7b-585c-428a-b08e-a3e7b8fd6923 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:27.514004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f06c7b-585c-428a-b08e-a3e7b8fd6923 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:27.514585 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f06c7b-585c-428a-b08e-a3e7b8fd6923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:27.540363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-36f06c7b-585c-428a-b08e-a3e7b8fd6923 None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:27.542501 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-36f06c7b-585c-428a-b08e-a3e7b8fd6923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:27.556690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 609/1215] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 21:55:27 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:27.581799 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835cd73-f1e9-470b-aa51-b09c44acf69f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:27.600320 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835cd73-f1e9-470b-aa51-b09c44acf69f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:27.607191 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26723548-7595-42b9-b737-5d4642ae8f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:27.611963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723548-7595-42b9-b737-5d4642ae8f80 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:27.612765 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723548-7595-42b9-b737-5d4642ae8f80 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:27.613050 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723548-7595-42b9-b737-5d4642ae8f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:27.625815 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26723548-7595-42b9-b737-5d4642ae8f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:27.627845 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26723548-7595-42b9-b737-5d4642ae8f80 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:27.653255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 607/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:55:34.319944 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5ded8-c5f6-4baf-bc35-c3fcb450455e None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:34.320571 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5ded8-c5f6-4baf-bc35-c3fcb450455e None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:34.320699 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5ded8-c5f6-4baf-bc35-c3fcb450455e None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:34.322271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 610/1217] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 21:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:55:34.329442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:34.329983 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:34.330099 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:34.358118 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:55:34.358118 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:55:34.362890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 608/1218] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 21:55:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:55:34.379569 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5ded8-c5f6-4baf-bc35-c3fcb450455e None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:34.394355 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5ded8-c5f6-4baf-bc35-c3fcb450455e None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:34.401192 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3fd95-b3fe-4d2c-bf6a-c13045d37ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:34.401826 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fd95-b3fe-4d2c-bf6a-c13045d37ea3 service nova] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:34.402085 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fd95-b3fe-4d2c-bf6a-c13045d37ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:34.402353 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3fd95-b3fe-4d2c-bf6a-c13045d37ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:34.412222 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3fd95-b3fe-4d2c-bf6a-c13045d37ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:34.414643 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3fd95-b3fe-4d2c-bf6a-c13045d37ea3 service nova] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:34.425123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 611/1219] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:55:44.346848 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=12 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:44.420179 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=15 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:55:46.545836 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:55:46.555010 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b2494-6bd2-4d7a-92ea-25eb60f4d587 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:55:46.558817 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f6174-fc13-4be2-a2b6-1bcb9763940d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:55:46.559477 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f6174-fc13-4be2-a2b6-1bcb9763940d service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:55:46.559753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f6174-fc13-4be2-a2b6-1bcb9763940d service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:55:46.560022 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f6174-fc13-4be2-a2b6-1bcb9763940d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:55:46.569296 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f6174-fc13-4be2-a2b6-1bcb9763940d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:55:46.570731 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f6174-fc13-4be2-a2b6-1bcb9763940d service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:55:46.582602 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 609/1220] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:55:46 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:55:56.576794 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=6 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:56:03.908871 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:56:03.909411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:56:03.909411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:56:03.928055 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:56:03.929246 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:56:03.936133 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 612/1221] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:56:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:56:04.233443 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d00f8-bb03-44ed-b9e5-7a1f221e8221 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:56:04.233982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d00f8-bb03-44ed-b9e5-7a1f221e8221 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:56:04.233982 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d00f8-bb03-44ed-b9e5-7a1f221e8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:56:04.252692 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-674d00f8-bb03-44ed-b9e5-7a1f221e8221 None None] MFA Rules not processed for user `7ae653f590784ee894b3d00dd83790f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:56:04.253877 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-674d00f8-bb03-44ed-b9e5-7a1f221e8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:56:04.260253 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 610/1222] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Jul 25 21:56:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:56:04.271051 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:56:04.280736 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5913a3-ce44-4017-8ad6-66b4ae4ae0d5 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:56:04.284275 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b968dc0-2e35-428e-b30b-e77e5fcaa43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:56:04.284880 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968dc0-2e35-428e-b30b-e77e5fcaa43b service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:56:04.285160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968dc0-2e35-428e-b30b-e77e5fcaa43b service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:56:04.285431 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968dc0-2e35-428e-b30b-e77e5fcaa43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:56:04.293135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b968dc0-2e35-428e-b30b-e77e5fcaa43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:56:04.294553 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b968dc0-2e35-428e-b30b-e77e5fcaa43b service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:56:04.302142 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 613/1223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:56:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:56:14.248733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:56:14.298974 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=9 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:56:28.002408 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cde0-000b-4690-b348-9da76ff80b28 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:56:28.002857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cde0-000b-4690-b348-9da76ff80b28 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:56:28.003004 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cde0-000b-4690-b348-9da76ff80b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:56:28.021773 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-5284cde0-000b-4690-b348-9da76ff80b28 None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:56:28.022963 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-5284cde0-000b-4690-b348-9da76ff80b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:56:28.030331 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 611/1224] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:56:28 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:56:38.016771 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:56:42.504977 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:56:42.505429 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:56:42.505573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:56:42.525458 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:56:42.526751 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:56:42.534059 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 614/1225] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:56:42 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:56:52.520555 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=3 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:57:38.955901 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:57:38.956391 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:57:38.956493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:57:38.974707 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:57:38.975936 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:57:38.982596 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 612/1226] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:57:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:57:48.969586 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=3 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:57:50.818104 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:57:50.837365 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad0921-c8c9-4235-bfbe-ffb1f3e1ce53 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:57:50.840779 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0a55-4950-45b4-9f28-5bed76fd4df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:57:50.841380 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0a55-4950-45b4-9f28-5bed76fd4df8 service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:57:50.841652 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0a55-4950-45b4-9f28-5bed76fd4df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:57:50.841921 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0a55-4950-45b4-9f28-5bed76fd4df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:57:50.850469 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0a55-4950-45b4-9f28-5bed76fd4df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:57:50.851961 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0a55-4950-45b4-9f28-5bed76fd4df8 service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:57:50.861084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 615/1227] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:57:50 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:58:00.857103 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=10 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:59:14.959614 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:59:14.980822 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26a7bb-2a99-498c-a8b0-88455321a84f None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:59:14.985642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a25b1-0dd9-4003-ae92-aa9fa41b48f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:59:14.986243 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a25b1-0dd9-4003-ae92-aa9fa41b48f9 service placement] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:59:14.986517 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a25b1-0dd9-4003-ae92-aa9fa41b48f9 service placement] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:59:14.986830 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a25b1-0dd9-4003-ae92-aa9fa41b48f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:59:14.994900 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a25b1-0dd9-4003-ae92-aa9fa41b48f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:59:14.996478 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a25b1-0dd9-4003-ae92-aa9fa41b48f9 service placement] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:59:15.005792 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 613/1228] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 21:59:14 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:59:25.002125 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=10 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:59:38.976092 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:59:38.976632 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:59:38.976794 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:59:38.996432 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] MFA Rules not processed for user `3008e360cec04afa8143b89cc97c1b37`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:59:38.997616 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:59:39.004465 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 616/1229] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 21:59:38 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:59:48.991484 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=3 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:00:00.938099 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:00:00.938674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:00:00.938674 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:00:00.958523 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:00:00.959772 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:00:00.966702 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 614/1230] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 22:00:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:00:04.832038 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:00:04.842845 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289740c-c804-4f3d-9578-3ff3f1e3c9a2 None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:00:04.847492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:00:04.848222 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:00:04.848713 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:00:04.849189 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:00:04.858795 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:00:04.860507 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:00:04.879251 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 617/1231] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:00:04 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:00:06.888909 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:00:06.920153 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0125-785b-449d-a7ce-cd0973adee30 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:00:06.926254 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:00:06.926988 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:00:06.927479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:00:06.928127 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:00:06.937359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:00:06.939199 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:00:06.950795 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 615/1232] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:00:06 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:00:14.866344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=6 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:00:16.945343 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=13 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:00:32.616638 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:00:32.623637 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:00:32.626405 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e9b51-10eb-48a6-9d88-28b2a1cafc0c service neutron] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:00:32.631078 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:00:32.631952 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:00:32.632322 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:00:32.632685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:00:32.635470 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675d28c-0a6c-481d-8661-2477c6b8a13e service nova] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:00:32.639938 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:00:32.640549 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:00:32.641356 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:00:32.641675 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:00:32.643624 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:00:32.645264 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:00:32.650450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:00:32.652365 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:00:32.660847 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 618/1233] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:00:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:00:32.663553 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 616/1234] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:00:32 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:00:33.949529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:00:33.957804 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb5b6e-e34e-409d-970a-ccf2d496d6ac service neutron] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:00:33.961832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:00:33.962428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:00:33.962702 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:00:33.963015 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:00:33.972231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:00:33.973692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:00:33.984763 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 619/1235] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:00:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:00:42.658804 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=6 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:00:43.979992 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=12 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:01:17.854450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:17.873038 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c57c2e-c14d-425a-8063-7bae429976fc service neutron] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:17.880379 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614513a-574e-49dd-aa59-6c2fe0f358c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:17.881417 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614513a-574e-49dd-aa59-6c2fe0f358c0 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:17.882608 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614513a-574e-49dd-aa59-6c2fe0f358c0 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:17.883361 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614513a-574e-49dd-aa59-6c2fe0f358c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:17.893682 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614513a-574e-49dd-aa59-6c2fe0f358c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:17.896532 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614513a-574e-49dd-aa59-6c2fe0f358c0 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:17.919510 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 617/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:01:17 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:01:25.809448 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:25.819160 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494f177-18f4-4105-908c-02f08c82ed1e service neutron] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:25.822735 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7ccae-0e69-4a4b-9305-06ba4e9cf70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:25.823374 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ccae-0e69-4a4b-9305-06ba4e9cf70d service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:25.823652 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ccae-0e69-4a4b-9305-06ba4e9cf70d service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:25.823919 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7ccae-0e69-4a4b-9305-06ba4e9cf70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:25.885887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ccae-0e69-4a4b-9305-06ba4e9cf70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:25.887363 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7ccae-0e69-4a4b-9305-06ba4e9cf70d service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:25.905729 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 620/1237] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:01:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:01:27.903688 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=6 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:01:29.048705 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3d81-f1d4-4f15-9a1a-c68590593abe None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:29.049278 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3d81-f1d4-4f15-9a1a-c68590593abe None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:29.049278 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db3d81-f1d4-4f15-9a1a-c68590593abe None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:29.050613 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 618/1238] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 22:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:01:29.063741 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad11d5-5869-488f-8f99-79fcd95bce35 None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:29.064220 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad11d5-5869-488f-8f99-79fcd95bce35 None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:29.064319 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad11d5-5869-488f-8f99-79fcd95bce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:29.127344 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-80ad11d5-5869-488f-8f99-79fcd95bce35 None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:01:29.128607 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-80ad11d5-5869-488f-8f99-79fcd95bce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:01:29.137619 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 621/1239] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 22:01:29 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:01:29.316181 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3d81-f1d4-4f15-9a1a-c68590593abe None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:29.329941 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db3d81-f1d4-4f15-9a1a-c68590593abe None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:29.336359 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8437c-d81d-40be-a768-a41605bc6ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:29.336988 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8437c-d81d-40be-a768-a41605bc6ca4 service placement] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:29.337268 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8437c-d81d-40be-a768-a41605bc6ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:29.337545 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8437c-d81d-40be-a768-a41605bc6ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:29.346805 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8437c-d81d-40be-a768-a41605bc6ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:29.349019 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8437c-d81d-40be-a768-a41605bc6ca4 service placement] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:29.359435 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 619/1240] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:01:29 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:01:32.582473 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac9d2-60b3-460b-90c0-3e16939066fa None None] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:32.583040 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac9d2-60b3-460b-90c0-3e16939066fa None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:32.583155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac9d2-60b3-460b-90c0-3e16939066fa None None] PATH_INFO: `/` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:32.585032 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 622/1241] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 22:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:01:32.613850 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] REQUEST_METHOD: `POST` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:32.614377 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:32.614377 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:32.635713 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.auth.core [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] MFA Rules not processed for user `7ae29498513e43c392540cb257913193`. Rule list: `[]` (Enabled: `True`). {{(pid=87160) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:01:32.638248 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:01:32.649462 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 620/1242] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 22:01:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:01:32.650451 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac9d2-60b3-460b-90c0-3e16939066fa None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:32.664166 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac9d2-60b3-460b-90c0-3e16939066fa None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:32.665972 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:32.669215 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:32.669928 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:32.670207 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:32.670478 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] PATH_INFO: `/v3/users/3008e360cec04afa8143b89cc97c1b37` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:32.671868 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3008e360cec04afa8143b89cc97c1b37)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:32.674035 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:32.676857 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d48ab0-c521-47a8-8782-fb68bf4b8b81 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:32.681885 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:32.682498 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:32.682774 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:32.683086 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:32.691448 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:32.693543 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:32.705055 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 621/1243] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:01:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:01:32.722529 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3008e360cec04afa8143b89cc97c1b37'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:32.723574 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3008e360cec04afa8143b89cc97c1b37'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:32.730893 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3008e360cec04afa8143b89cc97c1b37'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:32.731620 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3008e360cec04afa8143b89cc97c1b37'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:32.745481 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3008e360cec04afa8143b89cc97c1b37'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:32.758647 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 623/1244] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 22:01:32 2022] DELETE /identity/v3/users/3008e360cec04afa8143b89cc97c1b37 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:01:32.930373 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:32.943778 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbf59f-6cfa-426b-a5bf-9d5312ae1cdf service placement] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:33.000806 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:33.001447 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:33.001725 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:33.001998 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] PATH_INFO: `/v3/projects/b5c794ffb0b645f8be70f71ba4ce2a2d` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:33.003179 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c794ffb0b645f8be70f71ba4ce2a2d)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:33.005650 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:33.050283 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c794ffb0b645f8be70f71ba4ce2a2d', 'request_id': 'req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.056905 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c794ffb0b645f8be70f71ba4ce2a2d', 'request_id': 'req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.062430 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c794ffb0b645f8be70f71ba4ce2a2d', 'request_id': 'req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.075745 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] The token cache is being invalidate because project b5c794ffb0b645f8be70f71ba4ce2a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:01:33.076032 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.076753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.078255 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 622/1245] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 22:01:32 2022] DELETE /identity/v3/projects/b5c794ffb0b645f8be70f71ba4ce2a2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:01:33.082340 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:33.083765 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:01:33.096603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5e38-c06d-4338-b8f3-27eaf6aeea3f admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:33.108567 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:01:33.153492 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:33.154130 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:33.154411 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:33.154685 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] PATH_INFO: `/v3/users/0126a7ba07854f7fbbba0c1c444983af` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:33.155869 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0126a7ba07854f7fbbba0c1c444983af)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:33.157788 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:33.202692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0126a7ba07854f7fbbba0c1c444983af'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.203368 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0126a7ba07854f7fbbba0c1c444983af'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.210029 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0126a7ba07854f7fbbba0c1c444983af'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.210653 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0126a7ba07854f7fbbba0c1c444983af'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.222085 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-fd527392-89ec-478e-b527-49369b86542c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0126a7ba07854f7fbbba0c1c444983af'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.235812 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 624/1246] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 22:01:33 2022] DELETE /identity/v3/users/0126a7ba07854f7fbbba0c1c444983af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:01:33.413677 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:01:33.415118 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:01:33.430649 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d8e0-7a20-4aa9-bf8c-f84a5e7d8d14 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:01:33.482210 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:01:33.488583 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:01:33.489832 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:01:33.490442 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:01:33.490761 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] PATH_INFO: `/v3/projects/1655a4554dd049bebf9643bf80d1c19f` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:01:33.492213 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1655a4554dd049bebf9643bf80d1c19f)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:01:33.494452 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:01:33.538289 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1655a4554dd049bebf9643bf80d1c19f', 'request_id': 'req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.544118 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1655a4554dd049bebf9643bf80d1c19f', 'request_id': 'req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.549730 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1655a4554dd049bebf9643bf80d1c19f', 'request_id': 'req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.561432 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] The token cache is being invalidate because project 1655a4554dd049bebf9643bf80d1c19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87160) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:01:33.561733 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.562326 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:01:33.563823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 623/1247] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 22:01:33 2022] DELETE /identity/v3/projects/1655a4554dd049bebf9643bf80d1c19f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:01:43.232347 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:01:43.558642 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:02:10.233061 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:02:10.233591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:02:10.233591 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:02:10.253011 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] MFA Rules not processed for user `542a9d36a7b44e658747981f82df43e4`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:02:10.254242 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:10.311084 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 625/1248] 10.222.0.18 () {58 vars in 958 bytes} [Mon Jul 25 22:02:10 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:02:10.624479 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:02:10.625799 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:10.680450 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ba8b3-aea8-49e2-8c73-c41adcb008c0 admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:02:10.683924 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:02:10.684529 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:02:10.684803 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:02:10.685072 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:02:10.686748 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:10.696244 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:02:10.697650 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:02:10.705211 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 624/1249] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:02:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:02:12.146350 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:02:12.147824 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:12.218276 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e0606-b160-44c9-b7b0-d47c7aff788c None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:02:12.223071 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:02:12.224238 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:02:12.224510 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:02:12.224776 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:02:12.226470 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:12.237624 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:02:12.239255 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:02:12.248692 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 626/1250] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:02:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:02:20.455570 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:02:20.457057 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:20.530106 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03f619-2748-430c-935d-f93f3b85d2d5 service neutron] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:02:20.535271 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:02:20.536392 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:02:20.536664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:02:20.536940 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:02:20.538675 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:02:20.549986 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:02:20.552275 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8b53-712d-49d3-ba9e-7e4c415b2b19 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:02:20.561664 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 625/1251] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:02:20 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:02:22.244735 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=57 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:02:30.557769 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=58 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:04:20.277690 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:20.279135 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:20.341789 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844eedf-7229-4bac-b6a0-e9058b72e976 service placement] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:20.346832 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:20.347480 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:20.347770 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:20.348050 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:20.349805 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:20.362093 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:20.363748 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45279c8c-4e39-4258-9fea-f58a15ddbda5 service placement] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:20.374042 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 627/1252] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:04:20 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:04:30.369329 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=28 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:04:42.352493 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4aab-7adb-4ef9-bd39-cd41a6f8f4c5 None None] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:42.353011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4aab-7adb-4ef9-bd39-cd41a6f8f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:42.353011 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4aab-7adb-4ef9-bd39-cd41a6f8f4c5 None None] PATH_INFO: `/` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:42.354538 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 626/1253] 10.222.0.18 () {54 vars in 921 bytes} [Mon Jul 25 22:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:04:42.359777 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] REQUEST_METHOD: `POST` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:42.360603 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:42.360919 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:42.421003 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.auth.core [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] MFA Rules not processed for user `baf25ec0dbf04ddf86d1c26c1266d8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87159) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:04:42.422346 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:42.438957 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 628/1254] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Jul 25 22:04:42 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:04:42.445590 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4aab-7adb-4ef9-bd39-cd41a6f8f4c5 None None] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:42.468272 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4aab-7adb-4ef9-bd39-cd41a6f8f4c5 None None] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:42.482829 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf25ec0dbf04ddf86d1c26c1266d8b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:42.483472 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:42.483751 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:42.484090 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:42.493613 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:42.495344 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:42.506890 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 627/1255] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:04:42 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:04:48.016149 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:48.017649 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:48.028731 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b2864-7dda-4e58-831e-bbdc1e2cebbb None None] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:48.032287 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae653f590784ee894b3d00dd83790f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:48.032887 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] REQUEST_METHOD: `GET` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:48.033161 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:48.033426 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:48.035123 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:48.117518 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:48.118899 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:48.130060 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 629/1256] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:04:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:04:52.502753 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=6 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:04:54.359339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:54.361358 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:54.378039 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114a208-6345-43dc-b038-4b6078ef9e34 service nova] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:54.383560 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:54.384212 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:54.384661 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:54.385333 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] PATH_INFO: `/v3/users/542a9d36a7b44e658747981f82df43e4` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:54.402120 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] RBAC: Authorizing `identity:delete_user(user_id=542a9d36a7b44e658747981f82df43e4)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:54.403043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: WARNING py.warnings [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:04:54.403043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: warnings.warn(msg) Jul 25 22:04:54.403043 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: Jul 25 22:04:54.404849 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:54.468874 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542a9d36a7b44e658747981f82df43e4'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.479307 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542a9d36a7b44e658747981f82df43e4'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.480013 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542a9d36a7b44e658747981f82df43e4'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.498224 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542a9d36a7b44e658747981f82df43e4'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.505961 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542a9d36a7b44e658747981f82df43e4'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.512100 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 628/1257] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 22:04:54 2022] DELETE /identity/v3/users/542a9d36a7b44e658747981f82df43e4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:04:54.686268 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:54.697099 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179079-4467-4b7c-82a5-ce663fee1fba service neutron] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:54.753098 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:54.753730 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:54.754003 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:54.754271 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] PATH_INFO: `/v3/projects/6dc3059736e048c49f38255aa1d1f39b` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:54.764884 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc3059736e048c49f38255aa1d1f39b)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:54.765945 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: WARNING py.warnings [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:04:54.765945 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: warnings.warn(msg) Jul 25 22:04:54.765945 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: Jul 25 22:04:54.767176 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:54.809420 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:04:54.823231 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc3059736e048c49f38255aa1d1f39b', 'request_id': 'req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.836821 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc3059736e048c49f38255aa1d1f39b', 'request_id': 'req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.843511 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc3059736e048c49f38255aa1d1f39b', 'request_id': 'req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.855428 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] The token cache is being invalidate because project 6dc3059736e048c49f38255aa1d1f39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:04:54.855886 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.856508 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.858004 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 630/1258] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 22:04:54 2022] DELETE /identity/v3/projects/6dc3059736e048c49f38255aa1d1f39b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:04:54.862005 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:54.863424 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:54.876576 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2609ff9-69b8-4275-8b8d-87a9fe87884f admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:54.931914 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:54.932582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:54.932855 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:54.933122 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] PATH_INFO: `/v3/users/bb5b803504df482b881755ef7f48704a` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:54.934251 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5b803504df482b881755ef7f48704a)` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:54.936260 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:54.982014 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5b803504df482b881755ef7f48704a'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.988823 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5b803504df482b881755ef7f48704a'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.989468 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5b803504df482b881755ef7f48704a'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:54.994568 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:04:55.002828 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5b803504df482b881755ef7f48704a'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.010174 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.notifications [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5b803504df482b881755ef7f48704a'} {{(pid=87160) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.016582 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 629/1259] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Jul 25 22:04:54 2022] DELETE /identity/v3/users/bb5b803504df482b881755ef7f48704a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:04:55.189853 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Authenticating user token {{(pid=87159) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:04:55.191303 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.fernet_utils [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87159) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:04:55.205705 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ef24-51b1-4f1a-b1ac-3499b2423cf1 admin admin] Validating token access rules against request {{(pid=87159) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:04:55.273930 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5621789b9f4468f90a50f03b6178b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eb79fbfdb0c462f815d677c4fd9d2a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87159) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:04:55.274573 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:04:55.274850 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:04:55.275155 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] PATH_INFO: `/v3/projects/78c15661162c4e2fa4848b44bd814a81` {{(pid=87159) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:04:55.276294 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c15661162c4e2fa4848b44bd814a81)` {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:04:55.278198 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] RBAC: Authorization granted {{(pid=87159) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:04:55.322972 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c15661162c4e2fa4848b44bd814a81', 'request_id': 'req-5c15bcc8-bebd-4407-b984-cc5a0b232e17'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.329447 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c15661162c4e2fa4848b44bd814a81', 'request_id': 'req-5c15bcc8-bebd-4407-b984-cc5a0b232e17'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.335031 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c15661162c4e2fa4848b44bd814a81', 'request_id': 'req-5c15bcc8-bebd-4407-b984-cc5a0b232e17'} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.346791 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] The token cache is being invalidate because project 78c15661162c4e2fa4848b44bd814a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87159) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:04:55.347114 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.347712 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG keystone.notifications [None req-5c15bcc8-bebd-4407-b984-cc5a0b232e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87159) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:04:55.349180 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: [pid: 87159|app: 0|req: 631/1260] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Jul 25 22:04:55 2022] DELETE /identity/v3/projects/78c15661162c4e2fa4848b44bd814a81 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:05:05.012604 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG dbcounter [-] [87160] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:05:05.344065 dv-osbrick-849019-3-ceph devstack@keystone.service[87159]: DEBUG dbcounter [-] [87159] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:09:25.258277 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Authenticating user token {{(pid=87160) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:09:25.259839 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:09:25.338566 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c9f9-d14e-466b-8ae0-ef8d7ac69daa admin admin] Validating token access rules against request {{(pid=87160) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:09:25.399233 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ae29498513e43c392540cb257913193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be8e42ad23f3482693d306139f35777a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87160) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:09:25.399862 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] REQUEST_METHOD: `GET` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:09:25.400135 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] SCRIPT_NAME: `/identity` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:09:25.400402 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87160) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:09:25.402558 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.fernet_utils [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87160) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:09:25.413715 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:09:25.415339 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583353e-a0df-43ff-bbef-f8888a290c32 service placement] RBAC: Authorization granted {{(pid=87160) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:09:25.425634 dv-osbrick-849019-3-ceph devstack@keystone.service[87160]: [pid: 87160|app: 0|req: 630/1261] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Jul 25 22:09:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)